-- Logs begin at Fri 2022-07-01 18:44:19 UTC, end at Fri 2022-07-01 20:07:35 UTC. -- Jul 01 19:29:32.065976 dv-cinder-831247-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 19:29:32.076032 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 19:29:32 2022] *** Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: nodename: dv-cinder-831247-20-iscsi Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: machine: x86_64 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: clock source: unix Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: pcre jit disabled Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: detected number of CPU cores: 4 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: current working directory: / Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: detected binary path: /usr/bin/uwsgi-core Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: your processes number limit is 47680 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: your memory page size is 4096 bytes Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: detected max file descriptor number: 2048 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: lock engine: pthread robust mutexes Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: thunder lock: enabled Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 19:29:32.078028 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 19:29:32.122213 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: Python main interpreter initialized at 0x55c3668189c0 Jul 01 19:29:32.122213 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: python threads support enabled Jul 01 19:29:32.122213 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: your server socket listen backlog is limited to 100 connections Jul 01 19:29:32.122213 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: your mercy for graceful operations on workers is 90 seconds Jul 01 19:29:32.122731 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 19:29:32.122854 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: *** Operational MODE: preforking *** Jul 01 19:29:32.123308 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: *** uWSGI is running in multiple interpreter mode *** Jul 01 19:29:32.123308 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: spawned uWSGI master process (pid: 103406) Jul 01 19:29:32.123537 dv-cinder-831247-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 19:29:32.125421 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: spawned uWSGI worker 1 (pid: 103407, cores: 1) Jul 01 19:29:32.125421 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: spawned uWSGI worker 2 (pid: 103408, cores: 1) Jul 01 19:29:32.125421 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 19:29:32.772608 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:29:32.773237 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:29:33.873049 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:29:33.873049 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 01 19:29:33.873666 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:29:33.873666 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 01 19:29:33.876995 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:29:33.876995 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Jul 01 19:29:33.877526 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:29:33.877526 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Jul 01 19:29:36.337854 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:29:36.338436 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:29:36.338583 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:29:36.338931 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:29:36.339345 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:29:36.339442 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:29:36.339834 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:29:36.339945 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.340152 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.340370 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:29:36.340617 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.340733 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:29:36.340940 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.341161 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:29:36.341315 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.341552 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.341790 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.341881 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.342150 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.342256 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.342473 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.342573 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.342800 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.342897 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.343059 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.343156 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.343373 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.343476 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.343693 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-20-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.343783 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344012 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344101 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344301 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344391 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344608 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344703 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.344921 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345023 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-20-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345222 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345318 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345527 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345616 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345829 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.345933 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.346165 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.346339 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.346467 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.346788 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.347054 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.347163 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.347359 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.347569 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.347789 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.347911 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.348129 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.348236 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.348432 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.348534 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.348742 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.348867 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349068 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349200 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349352 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349476 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349662 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349799 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.349982 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.350111 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.350295 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.350495 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-20-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.350621 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.350741 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.350976 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.351094 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-20-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.351290 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.351420 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.351592 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.351716 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.351900 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.352049 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.352277 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.352408 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.352595 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.352727 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.352898 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353019 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353214 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353338 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353530 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353663 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353835 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.353985 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.354173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.354297 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.354485 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.354609 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.354784 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.354906 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355089 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355218 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355382 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355504 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355685 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355817 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.355980 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.356102 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.356280 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.356406 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.356524 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.356642 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.356871 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357006 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357148 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357270 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357450 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357573 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357766 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.357906 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358062 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358183 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358302 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358435 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358568 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358697 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.358876 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359007 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359177 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359307 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359481 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359607 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359783 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.359913 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360081 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360213 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360380 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360515 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360704 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360828 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.360948 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.361083 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.361250 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.361385 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.361547 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.361670 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.361847 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362004 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362184 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362315 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362486 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362618 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362798 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.362928 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.363099 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.363223 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.363410 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.363541 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.363710 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.363833 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364028 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364157 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364328 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364444 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364628 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364752 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.364940 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365063 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365243 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365364 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365543 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365674 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365842 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.365993 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.366173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.366298 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.366470 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.366605 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.366774 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.366897 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367068 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367205 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367325 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367595 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367720 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.367895 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368029 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368199 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368320 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368497 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368627 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368817 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.368948 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.369069 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.369188 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.369362 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.369485 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.369662 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.369825 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370010 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370136 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370267 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370388 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370552 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370697 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.370903 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371018 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371138 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371288 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371419 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371546 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371721 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371855 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.371999 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.372124 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.372325 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.372450 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.372627 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.372809 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.372933 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.373051 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.373212 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.373336 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.373511 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.373712 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.373841 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374050 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374187 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374308 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374428 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374560 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374718 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.374849 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375055 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375182 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375336 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375458 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375636 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375758 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.375943 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376068 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376245 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376371 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376541 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376661 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376849 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.376979 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.377141 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.377262 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.377440 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.377563 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.377722 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.377849 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378044 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378170 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378382 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378516 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378646 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378766 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.378940 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379071 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379235 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379366 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379531 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379661 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379825 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.379955 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.380118 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.380250 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.380409 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.380531 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.380703 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.380824 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.381022 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.381157 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.381277 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.381403 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.383797 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.383970 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.383970 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.384329 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.384329 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.384658 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.384843 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.385034 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.385225 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:29:36.385416 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.385598 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.385780 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.385983 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.386192 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.386376 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.386564 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.386749 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.386920 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.386920 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.387260 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.387445 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.387617 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.387791 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.387950 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.388101 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.388236 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.388356 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.389190 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.389381 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.389576 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.389983 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.390199 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.390391 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.390579 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.390707 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.390934 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.391226 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.391444 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.391637 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.391820 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.392000 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.392183 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.392371 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.392561 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.392742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.392922 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.393105 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.393286 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.393476 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.393673 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.393861 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.394064 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.394219 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.394398 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.394600 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.394791 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.394980 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.395174 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.395362 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.395552 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.395747 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.395935 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.396116 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.396296 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.396486 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.396697 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.396904 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.397090 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.397284 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.397475 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.397657 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.397844 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.398020 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.398182 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.398371 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.398551 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.398749 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.398926 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.399118 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.399304 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.399498 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.399682 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.399944 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.400194 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.400364 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.400557 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.400744 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.400923 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.401247 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.401416 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.401610 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.401797 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.402082 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.402259 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.402455 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.402651 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.402844 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.403033 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.403212 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.403392 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.403620 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.403877 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.404066 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.404259 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.404444 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.404682 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.404814 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.404961 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.405126 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.405304 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.405483 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.405670 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.405858 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.406029 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.406211 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.406388 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.406565 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.406762 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.406965 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.407150 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.407338 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.407530 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.407723 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.407923 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.408111 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.408288 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.408464 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.408650 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.408830 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.409014 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.409194 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.409370 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.409567 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.409760 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.409969 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.410179 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.410354 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.410530 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.410709 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.410889 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.411085 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.411381 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.411543 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.411720 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.411900 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.412079 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.412272 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.412471 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.412657 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.412843 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.413028 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.413216 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.413402 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.413579 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.413756 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.413934 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.414145 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.414340 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.414533 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.414722 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.414909 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.415087 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.415266 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.415452 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.415638 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.415816 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.416000 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.416185 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.416369 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.416573 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.416753 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.416941 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.417127 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.417306 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.417491 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.417738 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.417910 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.418114 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.418309 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.418504 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.418504 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.418866 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.419044 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.419249 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.419451 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.419631 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.419818 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.420004 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.420181 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.420360 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.420537 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.420714 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.420900 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.421085 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.421261 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.421504 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.421691 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.421888 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.422092 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.422273 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.422452 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.422642 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.422830 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.423022 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.423211 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.423396 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.423581 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.423766 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.423766 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.424107 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.424291 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.424475 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.424707 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.424894 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.425074 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.425259 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.425456 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.425640 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.425817 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.426061 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.426254 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.426442 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.426620 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.426799 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.426799 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.427128 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.427318 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.427513 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.427707 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.427899 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.428082 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.428258 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.428445 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.428627 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.428805 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.428981 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.429170 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.429358 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.429543 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.429729 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.429915 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.430111 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.430289 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.430465 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.430654 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.430843 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.431016 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.431193 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.431377 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.431634 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.431826 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.432007 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.432007 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.432341 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.432519 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.432712 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.432712 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.433071 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.433255 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.433439 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.433615 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.433800 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.434092 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.434277 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.434455 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.434640 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.434846 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.435161 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.435399 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.435603 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.435764 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.435948 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.436172 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.436333 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.436510 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.436741 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.436948 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.437126 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.437367 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.437514 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.437698 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.437874 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438022 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438146 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438284 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438406 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438525 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438690 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.438916 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439042 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439170 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439292 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439412 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439530 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439656 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439776 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.439907 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440037 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440157 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440284 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440405 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440542 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440663 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440783 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.440903 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441020 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441139 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441265 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441387 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441505 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441639 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441825 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.441970 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.442106 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.442237 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.442360 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.442480 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.442662 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443077 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443212 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443341 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443471 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443592 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443713 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443841 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.443962 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.444081 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.444200 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.444622 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.444745 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.444874 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.445464 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.445584 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.445703 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.445822 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.445941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446097 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446220 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446347 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446468 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446596 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446721 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446849 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.446969 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447088 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447206 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447326 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447453 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447575 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447701 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447822 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.447951 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448072 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448199 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448319 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448437 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448568 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448690 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448808 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.448939 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449060 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449178 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449295 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449413 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449539 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449687 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449809 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.449938 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.450394 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.450540 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.450674 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.450797 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.450925 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451045 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451170 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451289 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451421 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451542 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451661 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451789 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.451993 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452124 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452254 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452373 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452499 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452625 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452743 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.452912 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.453378 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.453500 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.453619 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.453738 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.453858 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454077 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454203 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454322 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454322 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454548 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454667 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454793 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.454914 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455097 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455097 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455324 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455562 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455682 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455802 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.455943 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456066 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456186 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456315 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456436 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456564 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456703 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456832 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.456953 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457073 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457200 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457320 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457454 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457650 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457780 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.457900 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.458055 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.458189 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.458310 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.458430 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.458549 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.458675 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459107 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459235 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459355 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459474 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459592 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459711 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459838 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.459958 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460077 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460197 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460315 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460433 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460560 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460681 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460800 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.460918 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461037 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461156 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461293 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461414 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461525 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461645 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461764 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.461883 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462033 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462222 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462348 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462468 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462588 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462716 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462837 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.462979 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463103 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463231 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463354 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463488 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463609 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463737 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463857 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.463979 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464099 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464232 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464354 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464474 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464593 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464719 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464848 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.464978 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465099 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465218 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465337 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465458 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465590 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465718 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.465837 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.466023 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.466447 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.466573 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.466712 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.466835 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.466955 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467081 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467201 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467201 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467433 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467562 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467712 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467834 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.467961 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468080 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468209 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468337 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468458 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468577 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468722 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468858 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468980 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468980 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.468980 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.469310 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.469437 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.469437 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.469675 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.469806 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.469927 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470094 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470214 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470347 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470468 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470587 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470708 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470826 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.470952 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471081 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471201 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471329 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471449 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471559 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471687 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471687 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.471687 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472018 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472136 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472341 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472476 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472597 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472726 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472855 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.472976 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473096 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473225 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473346 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473464 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473582 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473701 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473821 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.473991 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474114 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474233 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474362 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474482 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474611 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474763 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.474985 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475115 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475115 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475378 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475508 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475636 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475756 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.475876 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476002 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476130 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476257 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476476 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476598 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476732 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.476880 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477004 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477136 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477284 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477403 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477524 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477642 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477769 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.477891 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478037 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478160 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478279 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478406 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478540 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478668 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478668 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.478894 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479013 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479132 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479260 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479379 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479497 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479616 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479734 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.479979 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480100 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480226 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480346 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480464 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480591 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480711 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480829 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.480947 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481065 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481185 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481379 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481509 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481636 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481828 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.481828 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482111 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482249 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482465 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482590 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482710 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482829 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.482948 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483076 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483197 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483316 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483435 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483554 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483673 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483800 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.483920 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484038 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484156 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484304 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484454 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484577 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484696 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484844 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.484967 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485085 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485243 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485373 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485501 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485620 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485751 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.485878 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486027 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486148 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486276 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486395 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486525 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486672 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.486826 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487021 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487143 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487262 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487417 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487547 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487668 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487787 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.487905 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488023 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488148 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488276 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488405 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488526 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488654 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488773 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.488773 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489087 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489208 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489335 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489485 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489604 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489750 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.489880 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490129 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490255 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490374 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490689 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490819 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.490941 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491091 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491211 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491330 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491330 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491607 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491727 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491845 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491962 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.491962 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.492225 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.492339 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.492339 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.492684 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.492810 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.492937 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493097 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493218 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493359 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493487 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493608 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493767 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.493889 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494024 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494145 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494264 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494417 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494594 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494717 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494837 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.494992 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495121 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495271 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495402 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495532 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495532 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495759 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495879 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.495879 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496111 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496240 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496359 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496479 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496479 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496479 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496829 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.496951 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497070 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497196 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497196 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497481 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497604 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497723 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.497842 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498021 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498155 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498310 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498451 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498572 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498691 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498840 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.498971 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499099 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499247 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499387 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499521 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499641 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499759 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.499907 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500027 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500156 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500321 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500443 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500563 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500722 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.500981 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501102 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501223 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501361 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501482 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501611 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501732 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.501858 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.502014 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.502168 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.502316 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.502540 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.502679 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.502894 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503081 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503227 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503359 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503499 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503620 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503740 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503860 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.503988 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504117 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504247 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504382 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504504 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.504637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.505520 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.505520 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.505520 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.505875 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506011 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506142 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506142 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506371 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506491 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506491 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506730 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506858 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.506978 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.507097 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.507097 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.507484 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.507618 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.507792 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.507923 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508045 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508172 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508292 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508412 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508544 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508544 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508770 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.508889 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509063 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509190 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509324 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509465 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509594 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509744 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.509868 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510015 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510139 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510267 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510387 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510516 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510628 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510823 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.510950 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.511195 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.511342 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.511470 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.511750 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.511886 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.512167 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.512339 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.512529 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.512748 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.513011 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.513142 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.513429 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.513552 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.513751 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.514084 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.514229 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.514419 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.514608 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.514734 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.514928 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515052 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515238 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515428 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515552 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515681 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515855 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.515977 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.516147 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.516270 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.516441 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.516565 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.516720 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.516918 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517063 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517184 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517330 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517456 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517640 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517762 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.517940 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.518108 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.518283 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.518420 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.518588 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.518722 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.519493 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.519662 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.519783 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.519945 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520112 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520242 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520418 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520542 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520663 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520808 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.520945 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.521074 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.521251 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.521421 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.521546 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.521679 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.521828 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522016 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522153 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522363 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522518 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522685 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522805 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.522926 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.523171 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.523300 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.523421 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.523568 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.523767 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.523891 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524011 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524139 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524260 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524386 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524505 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524634 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524762 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.524883 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525011 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525145 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525268 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525386 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525505 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525683 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525827 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.525983 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.526144 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.526268 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.526389 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.526536 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.526697 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.526831 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527008 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527132 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527317 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527442 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527622 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527750 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.527929 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.528053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.528237 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.528364 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.528545 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.528770 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.528893 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.529013 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.529418 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.529547 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.529676 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.529806 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.529928 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530128 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530249 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530382 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530506 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530625 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530788 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.530998 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.531121 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.531248 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.531374 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534070 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534070 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534220 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534309 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534389 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534457 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534522 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534594 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534667 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534742 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534809 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534874 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.534939 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535004 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535069 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535142 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535209 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535273 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535339 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535403 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535477 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535544 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535615 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535682 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535682 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535807 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535881 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535948 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.535948 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536065 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536129 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536192 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536537 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536630 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536759 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.536994 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.537133 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.537277 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.537420 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.537562 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.537695 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.537879 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.538186 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.538293 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.538502 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.538591 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.538834 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.538920 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.539149 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.539252 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.539469 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.539555 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.539767 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.539862 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540068 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540156 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540374 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540462 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540679 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540766 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.540979 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.541066 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.541290 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.541378 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.541592 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.541677 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.541893 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.542013 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.542236 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.542323 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.542541 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.542627 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.542841 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.543068 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.543157 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.543415 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.543502 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.543730 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.543969 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.544065 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.544342 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.544433 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.544660 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.544835 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.544979 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.545073 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.545297 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.545383 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.545597 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.545695 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.545898 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546034 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546332 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546552 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546653 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546856 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.546990 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.547171 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.547297 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.547476 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.547609 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.547777 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.547908 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548081 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548213 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548382 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548506 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548681 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548812 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.548981 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.549112 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.549289 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.549415 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.549586 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.549709 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.549887 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550032 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550222 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550357 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550524 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550647 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550820 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.550951 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.551124 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.551249 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.551424 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.551548 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.551727 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.551860 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552022 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552145 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552320 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552444 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552617 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552747 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.552917 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.553041 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.553213 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.553335 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.553513 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.553648 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.553822 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554193 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554333 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554457 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554588 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.554960 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555079 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555198 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555326 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555447 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555641 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555766 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.555951 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.556076 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.556255 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.556378 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.556576 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.556701 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.556890 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.557013 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.557199 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.557414 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.557547 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.557745 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.557869 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.558092 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.558400 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.558527 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.558731 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.558856 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.559031 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.559162 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.559334 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.559465 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.559635 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.559760 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560034 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560173 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560346 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560471 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560654 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560780 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.560963 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.561096 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.561273 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.561398 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.561582 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.561706 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.561892 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562058 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562226 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562352 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562534 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562658 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562841 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.562968 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.563147 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.563271 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.563454 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.563579 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.563758 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.563882 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564061 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564183 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564366 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564497 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564674 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564798 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.564983 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.565113 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.565296 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.565426 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.565609 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.565731 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.565924 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566065 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566255 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566390 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566561 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566685 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566867 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.566992 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.567171 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.567296 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.567477 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.567599 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.567784 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.567908 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.568092 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.568219 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.568389 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.568511 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.568718 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.568841 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.569030 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.569154 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.569333 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.569457 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.569697 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.569833 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570155 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570348 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570472 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570667 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570804 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.570975 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.571107 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.571291 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.571421 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.571594 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.571726 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.571905 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572027 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572224 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572348 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572533 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572658 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572850 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.572973 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.573152 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.573283 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.573481 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.573604 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.573734 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.573857 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574056 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574183 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574374 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574502 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574683 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574807 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.574985 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.575109 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.575287 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.575412 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.575617 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.575752 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.575927 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576059 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576231 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576355 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576532 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576661 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576834 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.576998 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.577144 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.577314 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.577438 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.577622 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.577749 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.577928 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578176 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578297 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578417 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578549 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578674 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578841 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.578965 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.579145 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.579268 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.579449 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.579582 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.579754 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.579888 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580055 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580177 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580356 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580494 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580655 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.580956 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.581081 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.581255 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.581388 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.581556 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.581680 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.581857 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582004 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582211 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582345 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582527 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582649 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582835 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.582953 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.583151 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.583274 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.583458 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.583581 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.584078 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.584211 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.584388 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.584514 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.584704 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.584826 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585011 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585133 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585318 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585624 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585746 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.585928 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.586080 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.586261 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.586388 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.586572 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.586696 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.586878 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587010 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587188 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587321 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587493 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587616 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587805 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.587978 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.588116 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.588246 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.588425 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.588551 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.588732 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.588864 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589037 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589161 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589359 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589482 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589662 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589794 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.589984 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.590113 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.590302 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.590428 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.590609 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.590735 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.590936 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.591056 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.591264 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.591392 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.591571 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.591697 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.591880 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592031 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592188 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592327 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592492 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592616 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592805 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.592927 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.593124 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.593256 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.593446 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.593569 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.593757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.593889 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.594106 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.594246 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.594428 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.594550 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.594740 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.594866 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.595049 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.595169 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.595350 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.595483 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.595604 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:29:36.595724 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.596011 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.596315 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.596618 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:29:36.596860 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:29:36.748596 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Registered counter for database nova_api Jul 01 19:29:36.749800 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Registered counter for database nova_api Jul 01 19:29:36.769508 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:36.771101 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:36.776697 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:36.777580 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:36.833024 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.context [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbee45c5-2524-4b35-9632-4c8e49d2b565(cell1) {{(pid=103407) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:29:36.833260 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.context [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbee45c5-2524-4b35-9632-4c8e49d2b565(cell1) {{(pid=103408) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:29:36.837287 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:29:36.837422 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:29:36.838957 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:29:36.839087 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:29:36.839668 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:29:36.839814 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:29:36.841577 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:29:36.841714 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:29:36.843576 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Registered counter for database nova_cell0 Jul 01 19:29:36.843720 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Registered counter for database nova_cell0 Jul 01 19:29:36.849032 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Registered counter for database nova_cell1 Jul 01 19:29:36.849196 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Registered counter for database nova_cell1 Jul 01 19:29:36.858341 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:36.859991 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:36.861436 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:36.863991 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:36.865503 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:36.867120 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:36.872789 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:37.005565 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:37.012306 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Registered counter for database nova_cell0 Jul 01 19:29:37.015177 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Registered counter for database nova_cell0 Jul 01 19:29:37.022278 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:37.025845 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:29:37.027068 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:37.030266 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:29:37.357959 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:29:37.360443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:29:37.365172 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:29:37.367690 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:29:37.702336 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:29:37.708352 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:29:37.712592 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:29:37.713964 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c3668189c0 pid: 103408 (default app) Jul 01 19:29:37.716023 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:29:37.717234 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 01 19:29:37.717994 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Fri Jul 1 19:29:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:29:37.718692 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-7c37ed19-cfe7-4e64-b7bf-4fba76446bb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:29:37.723989 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c3668189c0 pid: 103407 (default app) Jul 01 19:30:53.114260 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:30:53.115805 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Jul 01 19:30:53.121185 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:30:53.128497 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:53.129898 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell1:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:53.131182 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:53.131900 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:53.556292 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-c36045b5-734a-4bfe-8a89-386c68884f13 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:30:53.586324 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-c36045b5-734a-4bfe-8a89-386c68884f13 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463059 Jul 01 19:30:53.587072 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jul 1 19:30:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:30:55.624309 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:30:55.625279 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-53f4af0f-5d7e-4609-a026-2b7290c455e8 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 01 19:30:55.626156 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:30:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:30:55.692515 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-60844afa-a049-4e68-9830-307d4d799fc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:30:55.711429 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.711429 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 01 19:30:55.742236 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-60844afa-a049-4e68-9830-307d4d799fc9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110103 Jul 01 19:30:55.742789 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:30:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:30:55.756621 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:55.757864 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:55.759453 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:55.760683 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:55.979760 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-cc794abc-a4c7-43df-8377-757769963308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:30:55.982463 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:55.982463 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 01 19:30:56.049775 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-cc794abc-a4c7-43df-8377-757769963308 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298555 Jul 01 19:30:56.050637 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jul 1 19:30:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:30:58.136524 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-60844afa-a049-4e68-9830-307d4d799fc9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:30:58.137544 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-60844afa-a049-4e68-9830-307d4d799fc9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 01 19:30:58.138077 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:30:58.258892 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-6b2c1063-5494-4b93-9558-7cd49cde0ce0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:30:58.276986 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:58.276986 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 01 19:30:58.295530 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-6b2c1063-5494-4b93-9558-7cd49cde0ce0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151596 Jul 01 19:30:58.296367 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:30:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:30:58.308256 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e8360af2-210f-47c4-aa16-1ce3589b366c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:30:58.309836 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:30:58.309836 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 01 19:30:58.342261 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e8360af2-210f-47c4-aa16-1ce3589b366c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037703 Jul 01 19:30:58.342846 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jul 1 19:30:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:31:00.409717 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-6b2c1063-5494-4b93-9558-7cd49cde0ce0 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:00.410770 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-6b2c1063-5494-4b93-9558-7cd49cde0ce0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 01 19:31:00.411170 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:00.470035 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-33f57b56-bdda-44c3-b9d5-8c5834dfdaba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "name": "ds1G", "vcpus": 1}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:00.489575 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-33f57b56-bdda-44c3-b9d5-8c5834dfdaba admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072590 Jul 01 19:31:00.490342 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:00.502946 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-d54240d9-7bef-4134-ac1f-56187be0da5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:00.527118 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-d54240d9-7bef-4134-ac1f-56187be0da5b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028627 Jul 01 19:31:00.528000 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jul 1 19:31:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:31:02.591398 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-33f57b56-bdda-44c3-b9d5-8c5834dfdaba admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:02.592403 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-33f57b56-bdda-44c3-b9d5-8c5834dfdaba admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Jul 01 19:31:02.592770 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:02.653308 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-5d3e2342-d256-4c1d-9ef2-ad5d6430df02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:02.671903 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-5d3e2342-d256-4c1d-9ef2-ad5d6430df02 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073188 Jul 01 19:31:02.672640 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:02.684580 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e56075b3-1fc0-4405-8fdd-7226f657e562 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:02.709650 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e56075b3-1fc0-4405-8fdd-7226f657e562 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028798 Jul 01 19:31:02.710476 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jul 1 19:31:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:31:04.820273 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-5d3e2342-d256-4c1d-9ef2-ad5d6430df02 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:04.821244 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-5d3e2342-d256-4c1d-9ef2-ad5d6430df02 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Jul 01 19:31:04.821922 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:04.885333 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc080174-12d8-4bfd-86c1-b6a2c6760ca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "swap": 0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:04.907578 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc080174-12d8-4bfd-86c1-b6a2c6760ca5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079085 Jul 01 19:31:04.908359 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:04.920239 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-7c639675-e6fa-406b-a059-165d826ca6d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:04.948483 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-7c639675-e6fa-406b-a059-165d826ca6d5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031880 Jul 01 19:31:04.949070 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Fri Jul 1 19:31:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:31:07.060736 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc080174-12d8-4bfd-86c1-b6a2c6760ca5 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:07.062726 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc080174-12d8-4bfd-86c1-b6a2c6760ca5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002558 Jul 01 19:31:07.063850 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:07.127176 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-fb299c8e-28ca-4877-8d25-a7f790eab2c2 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:07.154715 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-fb299c8e-28ca-4877-8d25-a7f790eab2c2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085012 Jul 01 19:31:07.155411 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jul 1 19:31:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:09.237068 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc080174-12d8-4bfd-86c1-b6a2c6760ca5 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:09.238132 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc080174-12d8-4bfd-86c1-b6a2c6760ca5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 01 19:31:09.238577 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:09.298792 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-794c03d3-d613-4d4a-860c-f0e87400789b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:09.317867 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-794c03d3-d613-4d4a-860c-f0e87400789b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072729 Jul 01 19:31:09.318439 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:09.333856 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-1aad32af-0e5d-41e6-890e-1b22c4c67309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:09.363419 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-1aad32af-0e5d-41e6-890e-1b22c4c67309 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034693 Jul 01 19:31:09.364175 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jul 1 19:31:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:31:11.562217 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-794c03d3-d613-4d4a-860c-f0e87400789b admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:11.563242 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-794c03d3-d613-4d4a-860c-f0e87400789b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jul 01 19:31:11.563654 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:11.631904 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-bab0621e-5ee6-4176-b86c-b66785081b85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:11.654274 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-bab0621e-5ee6-4176-b86c-b66785081b85 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082989 Jul 01 19:31:11.658095 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:11.669281 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c499a9e4-b56a-446a-942f-f6dbb6b05d6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:11.692705 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c499a9e4-b56a-446a-942f-f6dbb6b05d6a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027312 Jul 01 19:31:11.693287 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jul 1 19:31:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:31:13.854185 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-bab0621e-5ee6-4176-b86c-b66785081b85 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:13.855481 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-bab0621e-5ee6-4176-b86c-b66785081b85 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Jul 01 19:31:13.855974 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:13.922300 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f934a0ff-662a-471e-b664-33ee795942b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:13.943291 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-f934a0ff-662a-471e-b664-33ee795942b0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079844 Jul 01 19:31:13.943963 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:13.956101 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-20b82c59-1063-4417-9258-a6480b752762 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:13.980779 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-20b82c59-1063-4417-9258-a6480b752762 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028347 Jul 01 19:31:13.981372 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jul 1 19:31:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:31:16.046612 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f934a0ff-662a-471e-b664-33ee795942b0 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:16.047600 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-f934a0ff-662a-471e-b664-33ee795942b0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 01 19:31:16.048200 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:16.110122 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-62b08867-d783-44d0-a58c-b465ff7035fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "name": "m1.large", "vcpus": 4}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:16.129050 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-62b08867-d783-44d0-a58c-b465ff7035fe admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074810 Jul 01 19:31:16.129595 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:16.141991 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-b492ef47-e213-45e0-be47-4f51b6b0a099 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:16.165791 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-b492ef47-e213-45e0-be47-4f51b6b0a099 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027791 Jul 01 19:31:16.166507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jul 1 19:31:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:31:18.221786 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-62b08867-d783-44d0-a58c-b465ff7035fe admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:18.222853 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-62b08867-d783-44d0-a58c-b465ff7035fe admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 01 19:31:18.223391 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:18.283107 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-7dde092f-786b-44a9-8076-5e8e5d66eb61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:18.303499 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-7dde092f-786b-44a9-8076-5e8e5d66eb61 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073323 Jul 01 19:31:18.304414 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Fri Jul 1 19:31:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:18.316109 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ccf4ef2d-a76f-4ad8-8da6-78e5c958ff46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:18.354093 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ccf4ef2d-a76f-4ad8-8da6-78e5c958ff46 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041569 Jul 01 19:31:18.354714 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Fri Jul 1 19:31:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:31:42.870090 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-7dde092f-786b-44a9-8076-5e8e5d66eb61 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:42.871143 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-7dde092f-786b-44a9-8076-5e8e5d66eb61 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 01 19:31:42.871541 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:42.881868 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:42.934277 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-638d8e6a-5534-4933-bd74-f44e8b3ab20a admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:42.951680 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-638d8e6a-5534-4933-bd74-f44e8b3ab20a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074378 Jul 01 19:31:42.952233 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jul 1 19:31:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:43.898285 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-7dde092f-786b-44a9-8076-5e8e5d66eb61 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:43.899729 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-7dde092f-786b-44a9-8076-5e8e5d66eb61 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Jul 01 19:31:43.900276 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:44.099096 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-eed1995a-e727-4e47-8452-688401dc4baa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:44.105079 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-eed1995a-e727-4e47-8452-688401dc4baa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-eed1995a-e727-4e47-8452-688401dc4baa admin admin] Request method failure captured: Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Host: 10.222.0.61 Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABiv0ufZd4CaoPkXvExsleclm3_zVhnv-fEZewREJbRITB5DBm1wl4co80ePcrQ5JJLtgs8MUVlcPVHLh9NeunvGhE_i72FaJUVzohdSBJ67zLn0fOq-NokMX823HBAwhAjTdQGdOv9uUqMRyNzWg822XmabRNyluniMn559IBRr5PjbPk Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Role: member,admin,reader Jul 01 19:31:44.108334 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Roles: member,admin,reader Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c274d3083ff496a9f0346d090423253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c274d3083ff496a9f0346d090423253", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User: admin Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Id: 6b9038df7e244837aceca33ded6cf0a5 Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: method: > Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: exception: Flavor 42 could not be found. Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: action_args: {'id': '42'} Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:31:44.109742 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:44.110852 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.112021 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-eed1995a-e727-4e47-8452-688401dc4baa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:31:44.113067 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-eed1995a-e727-4e47-8452-688401dc4baa admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069342 Jul 01 19:31:44.113067 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jul 1 19:31:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:44.119805 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-114c8c85-182b-4272-b02a-b659cdb9bf7f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:44.122893 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:44.142380 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-114c8c85-182b-4272-b02a-b659cdb9bf7f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026012 Jul 01 19:31:44.142916 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jul 1 19:31:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:44.152795 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-205e8c15-b895-4663-9985-fdaa158e7410 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:44.176888 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-205e8c15-b895-4663-9985-fdaa158e7410 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025599 Jul 01 19:31:44.177402 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jul 1 19:31:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:44.187592 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-096941e8-b190-496e-af2b-9a78332f9f3d admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:44.193884 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-096941e8-b190-496e-af2b-9a78332f9f3d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-096941e8-b190-496e-af2b-9a78332f9f3d admin admin] Request method failure captured: Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Host: 10.222.0.61 Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABiv0ufZd4CaoPkXvExsleclm3_zVhnv-fEZewREJbRITB5DBm1wl4co80ePcrQ5JJLtgs8MUVlcPVHLh9NeunvGhE_i72FaJUVzohdSBJ67zLn0fOq-NokMX823HBAwhAjTdQGdOv9uUqMRyNzWg822XmabRNyluniMn559IBRr5PjbPk Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Role: member,admin,reader Jul 01 19:31:44.197173 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Roles: member,admin,reader Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c274d3083ff496a9f0346d090423253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c274d3083ff496a9f0346d090423253", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User: admin Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Id: 6b9038df7e244837aceca33ded6cf0a5 Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: method: > Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: exception: Flavor 42 could not be found. Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: action_args: {'id': '42'} Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:31:44.198731 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:44.199686 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:44.200786 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-096941e8-b190-496e-af2b-9a78332f9f3d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:31:44.201789 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-096941e8-b190-496e-af2b-9a78332f9f3d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015283 Jul 01 19:31:44.201789 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jul 1 19:31:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:45.033137 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-205e8c15-b895-4663-9985-fdaa158e7410 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:45.034248 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-205e8c15-b895-4663-9985-fdaa158e7410 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 01 19:31:45.034639 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:31:45.235123 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-5e832ac5-a5fe-4049-a60d-970055de0192 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:45.241329 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-5e832ac5-a5fe-4049-a60d-970055de0192 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-5e832ac5-a5fe-4049-a60d-970055de0192 admin admin] Request method failure captured: Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Host: 10.222.0.61 Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABiv0uh5z4AoGQv29EFyw3VBNhxNABiBtygmGXejuBo-dL3Us-g90jhuc0j_2O3QIwxxtpPLBkNmqvt4mfOL3fFxRBldb8-PjiJiCfH6KU1eT0Dbz5r5QGyy785nP_e2g2Q3v1Cd7QaA3c_tlK1cir0-buQ22XhrpbGPani6fyNjmlSSss Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Role: member,admin,reader Jul 01 19:31:45.242899 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Roles: member,admin,reader Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c274d3083ff496a9f0346d090423253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c274d3083ff496a9f0346d090423253", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User: admin Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Id: 6b9038df7e244837aceca33ded6cf0a5 Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: method: > Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: exception: Flavor 84 could not be found. Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: action_args: {'id': '84'} Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:31:45.244429 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:45.245282 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.246507 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-5e832ac5-a5fe-4049-a60d-970055de0192 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:31:45.247524 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-5e832ac5-a5fe-4049-a60d-970055de0192 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.073524 Jul 01 19:31:45.247524 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jul 1 19:31:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:45.254262 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-8b047cc9-24c0-4e11-bf63-9adef0e10554 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:45.269798 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-8b047cc9-24c0-4e11-bf63-9adef0e10554 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019175 Jul 01 19:31:45.270362 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jul 1 19:31:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:31:45.280156 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-825f8ee5-d518-44fc-9287-4acc9eef9568 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:45.295912 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-825f8ee5-d518-44fc-9287-4acc9eef9568 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019416 Jul 01 19:31:45.296455 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jul 1 19:31:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:45.308674 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-851bbf79-7796-4fec-a5ca-6f736a347f81 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:45.317226 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-851bbf79-7796-4fec-a5ca-6f736a347f81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-851bbf79-7796-4fec-a5ca-6f736a347f81 admin admin] Request method failure captured: Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Host: 10.222.0.61 Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABiv0uh5z4AoGQv29EFyw3VBNhxNABiBtygmGXejuBo-dL3Us-g90jhuc0j_2O3QIwxxtpPLBkNmqvt4mfOL3fFxRBldb8-PjiJiCfH6KU1eT0Dbz5r5QGyy785nP_e2g2Q3v1Cd7QaA3c_tlK1cir0-buQ22XhrpbGPani6fyNjmlSSss Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Role: member,admin,reader Jul 01 19:31:45.319492 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Roles: member,admin,reader Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c274d3083ff496a9f0346d090423253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c274d3083ff496a9f0346d090423253", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User: admin Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Id: 6b9038df7e244837aceca33ded6cf0a5 Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: method: > Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: exception: Flavor 84 could not be found. Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: action_args: {'id': '84'} Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:31:45.320907 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:45.321757 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:45.323244 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-851bbf79-7796-4fec-a5ca-6f736a347f81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:31:45.324443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-851bbf79-7796-4fec-a5ca-6f736a347f81 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017946 Jul 01 19:31:45.324443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Jul 1 19:31:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:46.140660 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-825f8ee5-d518-44fc-9287-4acc9eef9568 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:46.141701 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-825f8ee5-d518-44fc-9287-4acc9eef9568 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 01 19:31:46.142215 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:46.345821 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71e5ca97-c63b-48a4-bff8-9d4df51597eb admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:46.352053 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-71e5ca97-c63b-48a4-bff8-9d4df51597eb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71e5ca97-c63b-48a4-bff8-9d4df51597eb admin admin] Request method failure captured: Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Host: 10.222.0.61 Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABiv0uiUz4ilvlVI-Bz6IN12uPcmXNoJV9kd2CpgYc557h7mJtWohcBda1e23dAOF4-5ZZKt9ZyEYEAKdHfez3BnRirBEVPMsrEPx0mf0UpuGDH4LXBurLhGls-HrAEgnqtynQJq5uQGZY2cY1iYc_dpNgHt9tjyfmCkQR1B6RZ-E4gVxc Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Role: member,admin,reader Jul 01 19:31:46.353572 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Roles: member,admin,reader Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c274d3083ff496a9f0346d090423253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c274d3083ff496a9f0346d090423253", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User: admin Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Id: 6b9038df7e244837aceca33ded6cf0a5 Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: method: > Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: exception: Flavor 451 could not be found. Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: action_args: {'id': '451'} Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:31:46.354941 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:46.355792 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.357443 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-71e5ca97-c63b-48a4-bff8-9d4df51597eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:31:46.359076 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-71e5ca97-c63b-48a4-bff8-9d4df51597eb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075561 Jul 01 19:31:46.359076 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jul 1 19:31:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:46.369580 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-cc32a875-55d2-4e9a-aed5-59751ec97fbb admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:46.384816 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-cc32a875-55d2-4e9a-aed5-59751ec97fbb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020926 Jul 01 19:31:46.385339 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jul 1 19:31:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:46.394944 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:46.408673 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017284 Jul 01 19:31:46.409204 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Jul 1 19:31:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:31:46.420961 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f66d6285-a4b4-424a-87e3-94d7abbae766 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:46.426925 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-f66d6285-a4b4-424a-87e3-94d7abbae766 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f66d6285-a4b4-424a-87e3-94d7abbae766 admin admin] Request method failure captured: Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Host: 10.222.0.61 Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABiv0uiUz4ilvlVI-Bz6IN12uPcmXNoJV9kd2CpgYc557h7mJtWohcBda1e23dAOF4-5ZZKt9ZyEYEAKdHfez3BnRirBEVPMsrEPx0mf0UpuGDH4LXBurLhGls-HrAEgnqtynQJq5uQGZY2cY1iYc_dpNgHt9tjyfmCkQR1B6RZ-E4gVxc Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Role: member,admin,reader Jul 01 19:31:46.428435 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Roles: member,admin,reader Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c274d3083ff496a9f0346d090423253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c274d3083ff496a9f0346d090423253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c274d3083ff496a9f0346d090423253", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant-Id: 2c274d3083ff496a9f0346d090423253 Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User: admin Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Id: 6b9038df7e244837aceca33ded6cf0a5 Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: method: > Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: exception: Flavor 451 could not be found. Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: action_args: {'id': '451'} Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:31:46.430053 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:46.431028 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 01 19:31:46.432301 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f66d6285-a4b4-424a-87e3-94d7abbae766 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:31:46.433504 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-f66d6285-a4b4-424a-87e3-94d7abbae766 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012436 Jul 01 19:31:46.433504 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jul 1 19:31:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:47.270348 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:47.271348 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 01 19:31:47.271753 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:47.471522 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-5709419a-94b2-45f1-9468-2b63356d5695 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:47.497013 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-5709419a-94b2-45f1-9468-2b63356d5695 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.089883 Jul 01 19:31:47.497555 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jul 1 19:31:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:48.327159 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:48.328155 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 01 19:31:48.328552 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:48.525296 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-35c2c299-0a48-4177-9c70-fa9f00f7edd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:48.544893 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-35c2c299-0a48-4177-9c70-fa9f00f7edd9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078881 Jul 01 19:31:48.545471 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jul 1 19:31:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:49.360796 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:49.361898 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jul 01 19:31:49.362319 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:31:49.558341 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-2d645401-cc1f-41f3-afd6-e2448675be7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:49.581510 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-2d645401-cc1f-41f3-afd6-e2448675be7d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.081995 Jul 01 19:31:49.582118 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jul 1 19:31:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:50.444025 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:50.445008 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 01 19:31:50.445403 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:31:50.648159 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-bec6a2c0-76bc-4ef8-b0d0-6c24d459c077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:31:50.669120 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-bec6a2c0-76bc-4ef8-b0d0-6c24d459c077 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084974 Jul 01 19:31:50.669651 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Jul 1 19:31:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:31:51.495333 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:51.496335 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 01 19:31:51.496729 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:31:51.707399 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3195734d-3c66-418f-badd-477a61ad5d3e admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:31:51.729916 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3195734d-3c66-418f-badd-477a61ad5d3e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.091171 Jul 01 19:31:51.730482 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Fri Jul 1 19:31:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:32:38.279034 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:32:38.280919 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e858b9bb-968a-4c8a-aab5-573ac534f2d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Jul 01 19:32:38.280919 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Fri Jul 1 19:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:32:38.296434 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:38.346396 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-bb1d2334-fb8d-4350-ae52-85e3c3fd3da2 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:32:38.365298 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-bb1d2334-fb8d-4350-ae52-85e3c3fd3da2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075243 Jul 01 19:32:38.365799 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Fri Jul 1 19:32:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:32:38.389884 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d113e50b-99a9-4f94-9df5-aed534428a6e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:32:38.393385 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=14 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:38.399299 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-d113e50b-99a9-4f94-9df5-aed534428a6e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014136 Jul 01 19:32:38.399913 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Fri Jul 1 19:32:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:32:38.411595 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-d5e3a92a-6429-4b22-a3e2-cd96490209b4 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:32:38.419633 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-d5e3a92a-6429-4b22-a3e2-cd96490209b4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011568 Jul 01 19:32:38.420143 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Fri Jul 1 19:32:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:32:38.431213 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:32:38.439310 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011612 Jul 01 19:32:38.439841 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Fri Jul 1 19:32:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:32:38.450713 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f4c77bf2-8be8-4e08-b210-09c848d5d1b6 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:32:38.458769 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-f4c77bf2-8be8-4e08-b210-09c848d5d1b6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011533 Jul 01 19:32:38.459291 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Fri Jul 1 19:32:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:36:15.299102 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:15.300128 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 01 19:36:15.300546 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:36:15.445372 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=6 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:15.576511 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-2cec4c7a-c333-4496-81a8-b70115c9c4d5 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:15.578746 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:36:15.578746 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 01 19:36:15.580566 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-2cec4c7a-c333-4496-81a8-b70115c9c4d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:15.581251 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-2cec4c7a-c333-4496-81a8-b70115c9c4d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:15.582465 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-2cec4c7a-c333-4496-81a8-b70115c9c4d5 admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:15.583135 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-2cec4c7a-c333-4496-81a8-b70115c9c4d5 admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:15.618866 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-2cec4c7a-c333-4496-81a8-b70115c9c4d5 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.181890 Jul 01 19:36:15.619449 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jul 1 19:36:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:36:16.487215 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:16.488620 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 Jul 01 19:36:16.489230 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:36:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:36:16.702006 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-94ba66f9-1ce7-4c12-a69a-cf4c7059f431 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:16.703204 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:36:16.703204 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 01 19:36:16.704521 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-94ba66f9-1ce7-4c12-a69a-cf4c7059f431 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:16.704995 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-94ba66f9-1ce7-4c12-a69a-cf4c7059f431 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:16.705783 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-94ba66f9-1ce7-4c12-a69a-cf4c7059f431 admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:16.706311 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-94ba66f9-1ce7-4c12-a69a-cf4c7059f431 admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:16.725773 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-94ba66f9-1ce7-4c12-a69a-cf4c7059f431 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.088920 Jul 01 19:36:16.726338 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jul 1 19:36:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:36:27.985218 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:27.986263 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 01 19:36:27.986688 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:36:28.132610 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:28.133341 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:28.133973 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=8 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:28.192440 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-870f23b8-d97e-44e6-863b-952e9ea2ae8e admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:28.194280 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:36:28.194280 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 01 19:36:28.196027 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-870f23b8-d97e-44e6-863b-952e9ea2ae8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:28.196640 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-870f23b8-d97e-44e6-863b-952e9ea2ae8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:28.197919 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-870f23b8-d97e-44e6-863b-952e9ea2ae8e admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:28.198352 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-870f23b8-d97e-44e6-863b-952e9ea2ae8e admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:28.229318 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-870f23b8-d97e-44e6-863b-952e9ea2ae8e admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.101121 Jul 01 19:36:28.229874 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jul 1 19:36:28 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:36:29.062831 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:29.063839 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b23f3964-35e7-4c67-94ed-7f7c62f8773d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jul 01 19:36:29.064277 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Jul 1 19:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:36:29.268641 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3b5650b5-7f79-4faa-a063-7053f9fce75a admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:36:29.269804 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:36:29.269804 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 01 19:36:29.270999 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3b5650b5-7f79-4faa-a063-7053f9fce75a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:29.271431 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3b5650b5-7f79-4faa-a063-7053f9fce75a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:29.272228 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3b5650b5-7f79-4faa-a063-7053f9fce75a admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:36:29.272646 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3b5650b5-7f79-4faa-a063-7053f9fce75a admin admin] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:36:29.294463 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3b5650b5-7f79-4faa-a063-7053f9fce75a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087173 Jul 01 19:36:29.297985 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Jul 1 19:36:29 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:37:28.324935 dv-cinder-831247-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 01 19:37:28.325496 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: Fri Jul 1 19:37:28 2022 - graceful shutdown triggered... Jul 01 19:37:28.326295 dv-cinder-831247-20-iscsi devstack@n-api.service[103408]: Gracefully killing worker 2 (pid: 103408)... Jul 01 19:37:28.326651 dv-cinder-831247-20-iscsi devstack@n-api.service[103407]: Gracefully killing worker 1 (pid: 103407)... Jul 01 19:37:29.326204 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: worker 1 buried after 1 seconds Jul 01 19:37:29.326204 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: worker 2 buried after 1 seconds Jul 01 19:37:29.326204 dv-cinder-831247-20-iscsi devstack@n-api.service[103406]: goodbye to uWSGI. Jul 01 19:37:29.327893 dv-cinder-831247-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 01 19:37:29.328492 dv-cinder-831247-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 01 19:37:29.331338 dv-cinder-831247-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 19:37:29.341265 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 19:37:29 2022] *** Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: nodename: dv-cinder-831247-20-iscsi Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: machine: x86_64 Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: clock source: unix Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: pcre jit disabled Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: detected number of CPU cores: 4 Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: current working directory: / Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: detected binary path: /usr/bin/uwsgi-core Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: your processes number limit is 47680 Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: your memory page size is 4096 bytes Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: detected max file descriptor number: 2048 Jul 01 19:37:29.343231 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: lock engine: pthread robust mutexes Jul 01 19:37:29.344200 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: thunder lock: enabled Jul 01 19:37:29.344200 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 19:37:29.344200 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 19:37:29.387307 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: Python main interpreter initialized at 0x55ee7c19e9c0 Jul 01 19:37:29.387307 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: python threads support enabled Jul 01 19:37:29.387307 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: your server socket listen backlog is limited to 100 connections Jul 01 19:37:29.387307 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: your mercy for graceful operations on workers is 90 seconds Jul 01 19:37:29.387767 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 19:37:29.387767 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: *** Operational MODE: preforking *** Jul 01 19:37:29.388036 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: *** uWSGI is running in multiple interpreter mode *** Jul 01 19:37:29.388036 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: spawned uWSGI master process (pid: 124334) Jul 01 19:37:29.388260 dv-cinder-831247-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 19:37:29.393988 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: spawned uWSGI worker 1 (pid: 124349, cores: 1) Jul 01 19:37:29.393988 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: spawned uWSGI worker 2 (pid: 124350, cores: 1) Jul 01 19:37:29.393988 dv-cinder-831247-20-iscsi devstack@n-api.service[124334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 19:37:30.053373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:37:30.054021 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:37:31.253330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:37:31.253330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: from cryptography.utils import int_from_bytes Jul 01 19:37:31.254287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:37:31.254287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: from cryptography.utils import int_from_bytes Jul 01 19:37:31.254709 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:37:31.254709 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: from cryptography.utils import int_from_bytes Jul 01 19:37:31.255148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:37:31.255148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: from cryptography.utils import int_from_bytes Jul 01 19:37:33.628473 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:37:33.629113 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:37:33.629275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:37:33.629637 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:37:33.629872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:37:33.630300 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.630636 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.630947 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.631264 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.631592 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.631878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.632253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.632579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.632907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.633171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.633486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.633810 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-20-iscsi {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.634152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.634461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.634773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.635095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.635383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.635707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.636014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.636518 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.638000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.638000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.638000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.638693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.638693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.639099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:37:33.639761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.639984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:37:33.640210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.640210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.640626 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:37:33.640843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.641065 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:37:33.641311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.641521 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:37:33.641752 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-20-iscsi {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.641982 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.642220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.642440 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.642649 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.642851 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.643066 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.643276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.643276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.643651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.643651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.643977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644138 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.644958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.645254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.645407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.645556 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.645715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-20-iscsi {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.645865 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646411 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.646997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.648208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.648368 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.648515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.648676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.648819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649206 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649641 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.649994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.650156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.650307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.650451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.650617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.650766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.650927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.651082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.651255 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.651400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.651594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.651753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.651913 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.652077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.652231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.652392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.652392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.652682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.652842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-20-iscsi {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.653913 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.654176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.654176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.654481 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.654641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.654792 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.654942 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655084 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655250 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655554 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.655987 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.656154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.656323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.656471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.656629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.656771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.656920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.657078 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.657261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.657771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.657960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.658111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.658111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.658395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.658395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.658694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.658694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659316 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.659916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.660069 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.660227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.660376 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.660529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.660696 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.660852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661440 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661591 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661743 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.661905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.662213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.662213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.662515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.662666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.662869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.663963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.664107 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.664255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.664421 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.664577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.664728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.664870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665021 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665747 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.665899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.666091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.666246 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.666415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.666560 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.666709 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.666859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.667001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.667001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.667368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.667368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668313 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668313 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.668919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.669070 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.669214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.669364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.669506 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.669654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.669812 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670517 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.670976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.671123 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.671273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.671424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.671582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.671737 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.671881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672022 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672466 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672628 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672776 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.672937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.673087 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.673236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.673389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.673542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.673690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.673841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674020 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.674902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675361 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675652 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675800 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.675959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.676109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.676251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.676399 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.676552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.676703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.676857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.677000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.677148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.677298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.677447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.677882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.678094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.678243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.678385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.678534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.678688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.678846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.678997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.679186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.679342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.679498 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.679641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.679785 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.679934 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.680076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.680226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.680378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.680528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.680681 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.680893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.681051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.681215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.681365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.681514 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.681664 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.681809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.682033 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.682199 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.682344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.682496 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.682645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.682811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.682965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.683125 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.683269 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.683418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.683561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.683711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.683862 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.684016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.684159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.684301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.684453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.684608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.684760 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.684910 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.685053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.685194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.685349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.685492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.685642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.685784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.685926 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.686104 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.686248 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.686404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.686569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.686727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.686882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.687025 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.687167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.687307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.687457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:37:33.687612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688046 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688204 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688504 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688504 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688796 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.688945 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.689095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.689248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.689406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.689563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.689715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.689858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690045 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690202 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690663 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.690971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.691114 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.691268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.691420 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.691563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.691720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.691864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692006 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.692904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.693124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.693276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.693419 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.693568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.693711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.693853 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.694031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.694187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.694346 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.694498 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.694664 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.694861 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695018 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695462 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695604 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.695919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696073 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.696970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.697112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.697264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.697413 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.697570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.697713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.697854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.698238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.698402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.698546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.698546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.698852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699152 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699294 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699446 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699603 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.699888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.700039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.700190 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.700343 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.700868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.701152 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.701300 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.701443 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.701592 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.701746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.701896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.702959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.703237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.703378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.703529 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.703679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.703830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.703972 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.704114 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.704263 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.704406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.704555 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.704698 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.704847 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705007 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705577 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.705861 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706069 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.706985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.707129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.707277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.707428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.707570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.707723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.707873 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.708017 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.708364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.708513 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.708661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.708815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.708968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.709112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.709261 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.709406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.709555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.709707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.709850 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.710021 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.710191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.710348 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.710540 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.710694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.710844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711004 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711155 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711306 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711462 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711755 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.711906 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712071 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712220 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.712971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.713120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.713272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.713416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.713564 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.713717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.713867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714056 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714211 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714357 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.714954 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715831 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.715981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.716124 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.716274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.716417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.716566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.716735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.716886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.717030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.717171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.717313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.717456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.717696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.717876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.718068 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.718534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.718744 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.718937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.719115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.719310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.719489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.719674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.719859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.720045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.720224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.720408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.720595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.720772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.720772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.721124 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.721300 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.721476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.721678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.721855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.722055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.722247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.722425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.722605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.722791 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.722980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.723238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.723417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.723593 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.723770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.724442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.724910 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.725078 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.725224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.725368 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.725517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.725667 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.725817 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726033 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726788 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.726979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.727126 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.727274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.727417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.727558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.727706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.727860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.728005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.728153 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.728303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.728667 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.728829 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.728986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.729130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.729272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.729272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.729557 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.729719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.729871 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.730150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.730353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.730510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.730655 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.730806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.730949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.731111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.731254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.731395 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.731564 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.732311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.732480 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.732636 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.732796 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.732947 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.733109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.733261 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.733419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.733568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.733730 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.733878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.734070 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.734231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.734383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.734531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.734679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.734834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735777 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.735941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.736106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.736262 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.736420 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.736569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.736731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.736880 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.737036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.737186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.737931 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.738135 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.738317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.738478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.738834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739301 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739618 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739767 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.739922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.740071 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.740226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.740389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.740559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.740716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.740866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.741016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.741178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.741336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.741494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.741494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.741858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.742040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.742212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.742362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.742528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.742700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.742858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743328 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.743938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.744099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.744251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.744412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.744575 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.744749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.744899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.745049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.745212 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.745363 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.745522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.745671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.745828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746007 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746162 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746482 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746649 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746649 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.746965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.747116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.747278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.747428 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.747577 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.747725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.747883 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.748032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.748195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.748352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.748502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.748668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.749034 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.749195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.749398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.749557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.749707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.749855 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750021 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750342 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.750975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.751185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.751344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.751500 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.751650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.751804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.751954 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.752112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.752271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.752427 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.752578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.752726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.752886 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.753051 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.753209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.753367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.753522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.753678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.753828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754017 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.754928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755388 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.755997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.756152 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.756302 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.756457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.756684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.756835 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757788 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.757964 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.758137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.758298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.758448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.758605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.758755 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.759140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.759325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.759479 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.759627 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.759783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.759939 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.760098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.760260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.760419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.760576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.760726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.760881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.761039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.761205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.761362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.761512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.761678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.761836 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.762051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.762214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.762386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.762547 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.762705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.762862 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.763097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.763249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.763588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.763747 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.763897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.764984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.765134 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.765283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.765443 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.765605 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.765763 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.765928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.766114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.766273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.766432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.766582 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.766732 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.766894 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767192 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767823 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.767981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.768131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.768278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.768433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.768592 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.768748 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.768899 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.769247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.769414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.769574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.769733 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.769903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.770115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.770276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.770427 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.770585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.770747 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.770908 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.771059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.771216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.771366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.771523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.771680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.771848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.772014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.772171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.772325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.772492 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.772688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.772892 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773068 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773221 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773221 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.773995 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.774163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.774320 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.774484 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.774634 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.774793 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.774944 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.775094 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.775243 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.775404 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.775554 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.775711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.775861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776020 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776184 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776335 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.776958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777441 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777591 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.777897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.778230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.778380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.778528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.778683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.778832 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.778989 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.779359 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.779527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.779678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.779678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.779976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.780136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.780297 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.780450 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.780606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.780762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.780926 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.781075 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.781248 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.781523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.781679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.781971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.782158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.782320 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.782499 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.782657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.782815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.782973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.783137 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.783293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.783450 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.783601 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.783750 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.783910 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.784066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.784224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.784374 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.784543 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.784693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.784850 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.785008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.785156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.785312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.785462 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.785627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.785790 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.786047 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.786226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.786379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.786528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.786691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.786860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787159 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.787928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.788078 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.788235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.788393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.788585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.788585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.788890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.789040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.789188 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.789518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.789684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.789684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.789990 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.790146 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.790296 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.790296 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.790596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.790596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.790896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.791049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.791205 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.791362 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.791543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.791761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.791918 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.792067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.792216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.792381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.792551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.792701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.792860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.793011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.793167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.793167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.793543 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.793693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.793855 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.794070 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.794224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.794383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.794534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.794691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.794840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795169 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.795941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.796104 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.796254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.796411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.796568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.796718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.796867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797335 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797484 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797633 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.797964 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.798122 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.798283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.798434 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.798598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.798756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.798938 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.799091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.799240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.799540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.799721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.799887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.800037 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.800205 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.800357 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.800553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.800714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.800876 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.801034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.801330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.801502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.801663 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.801905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.802121 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.802273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.802441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.802600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.802760 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.802918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.803082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.803233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.803389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.803559 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.803559 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.803866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804241 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.804879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.805163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.805163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.805480 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.805639 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.805789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.805789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.806125 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.806275 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.806441 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.806441 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.806737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.806737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807019 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807328 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807328 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.807940 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.808090 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.808252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.808402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.808558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.808716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.808874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.809033 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.809183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.809338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.809499 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.809818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.810050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.810220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.810379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.810536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.810694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.810845 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.811009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.811168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.811318 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.811474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.811631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.811793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.812049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.812214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.812372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.812540 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.812691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.812841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.813964 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.814120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.814284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.814435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.814435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.814719 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.814881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.815032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.815180 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.815337 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.815487 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.815698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.815946 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.816107 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.816259 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.816424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.816581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.816783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.816936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.817087 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.817237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.817387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.817562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.817868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.818054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.818236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.818394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.818553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.818704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.818911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.819075 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.819236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.819387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.819537 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.819870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820041 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820367 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.820992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.821141 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.821300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.821456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.821614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.821777 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.821928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.822252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.822548 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.822728 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.822881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823040 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823537 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.823995 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.824146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.824297 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.824455 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.824605 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.824781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.824959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.825379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.825896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826380 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826537 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.826992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.827148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.827307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.827307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.827626 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.827783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.827939 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.828096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.830902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.831100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.831100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.831417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.831571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.831735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.831886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.832050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.832050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.832465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.832711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.832880 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.833032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.833197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.833364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.833514 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.833680 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.833842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.834295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.834466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.834640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.834799 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.834962 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.835114 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.835272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.835483 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.835648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.835808 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.835970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.836120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.836120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.836120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.836650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.836817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.836971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.837128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.837278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.837429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.837579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.837738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.837897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.838111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.838266 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.838266 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.838266 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.838725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.838877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839647 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839647 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.839933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.840082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.840239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.840398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.840560 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.840709 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.840981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.841136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.841136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.841502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.841502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.841813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.841991 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.842149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.842330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.842591 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.842857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843479 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843644 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843644 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.843934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844611 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.844958 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845533 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845765 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.845874 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.846405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.846575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.846726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.846884 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847628 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.847934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.848084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.848233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.848392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.848552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.848710 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.848710 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.849003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.849160 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.849309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.849542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.849702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.849859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.850049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.850219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.850219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.850527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.850682 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.850832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.851254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.851423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.851591 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.851751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.851919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.851919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.852208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.852208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.852523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.852786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853329 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853488 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853645 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853645 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.853958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.854116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.854116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.854416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.854567 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.854728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.854879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.855818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.856129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.856281 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.856445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.856594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.856780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.857057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.857236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.857400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.857551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.857707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.857707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858037 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.858979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859141 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859604 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859753 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.859928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.860222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.860378 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.860528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.860684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.860854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.861012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.861179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.861410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.861565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.861722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.861881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.862054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.862217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.862368 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.862517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.862680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.862928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.863175 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.863175 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.863475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.863633 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.863797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.863947 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.864095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.864252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.864252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.864550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.865322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.865487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.865651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.865800 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.865988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.866145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.866309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.866461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.866648 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.866808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.866959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.867117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.867265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.867415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.867571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.867740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.867888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868046 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.868985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.869135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.869296 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.869445 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.869445 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.869741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.869903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.870088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.870238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.870387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.870537 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.870694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.870852 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.871008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.871159 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.871159 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.871536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.871719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.872038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.872206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.872366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.872366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.872652 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.872820 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.873062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.873319 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.873483 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.873634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.873792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.873967 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.874135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.874302 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.874522 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.874642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.874768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.874888 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875227 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875589 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875700 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875920 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.875920 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876377 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.876921 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877029 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.877837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.878008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.878524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.878703 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.878856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879316 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.879861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.880879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.881324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.881480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.881736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.881894 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.882089 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.882324 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.882538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.882723 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.882930 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.883099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.883099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.883588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.883749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.883920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.884080 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.884240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.884390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.884593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.884775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.884927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.885084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.885243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.885393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.885551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.885708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.885859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.886091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.886260 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.886412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.886575 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.886726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.886875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887499 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.887968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.888118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.888286 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.888438 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.888597 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.888746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.888902 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.889821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.890310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.890498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.890648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.890796 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.890954 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.891110 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.891268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.891425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.891576 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.891750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892621 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.892946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.893097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.893097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.893471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.893711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.893877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.894072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.894072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.894373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.894524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.894673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.894831 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895181 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895636 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895801 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.895951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.896111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.896268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.896425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.896590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.896749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.896907 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.897841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898354 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.898547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.899689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.901039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.903860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.905050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.906242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.907412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.908458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:37:33.909226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:37:33.944834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Registered counter for database nova_api Jul 01 19:37:33.966534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:33.972964 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Registered counter for database nova_api Jul 01 19:37:33.973671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:33.993557 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.000501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.029695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.context [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbee45c5-2524-4b35-9632-4c8e49d2b565(cell1) {{(pid=124349) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:37:34.033873 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:37:34.035480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:37:34.036264 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:37:34.038276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:37:34.040494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Registered counter for database nova_cell0 Jul 01 19:37:34.046353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Registered counter for database nova_cell1 Jul 01 19:37:34.052411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.053777 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.060699 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.060891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.context [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbee45c5-2524-4b35-9632-4c8e49d2b565(cell1) {{(pid=124350) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:37:34.062040 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.065119 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:37:34.066834 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:37:34.067637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:37:34.069719 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:37:34.071878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Registered counter for database nova_cell0 Jul 01 19:37:34.076323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Registered counter for database nova_cell1 Jul 01 19:37:34.083888 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.085728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.090884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.208086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Registered counter for database nova_cell0 Jul 01 19:37:34.215082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.219845 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.228426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.238884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Registered counter for database nova_cell0 Jul 01 19:37:34.247902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:37:34.252638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:37:34.537598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:37:34.544877 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:37:34.567835 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:37:34.575326 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:37:34.908417 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:37:34.915684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-3c573a65-cfc8-4e6c-989b-cad779bf85e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:37:34.920638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:37:34.921145 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee7c19e9c0 pid: 124349 (default app) Jul 01 19:37:34.926715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-b086fba7-2679-4ff5-82fd-fb5a031196bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:37:34.932424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee7c19e9c0 pid: 124350 (default app) Jul 01 19:38:16.432574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.434904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.436803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.437713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:17.773176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-51162644-4b59-4d2e-a83f-2e51292b995d tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Action: 'create', calling method: .version_select at 0x7f47667fc3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2033363154"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:19.258484 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-51162644-4b59-4d2e-a83f-2e51292b995d tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.835202 Jul 01 19:38:19.260182 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1154 bytes} [Fri Jul 1 19:38:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2839 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 19:38:19.274159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:19.275311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:19.276115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:19.285621 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:19.748824 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e0efce61-864f-44af-94ec-dcb955fe583d tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47668b6ee0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:20.344920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e0efce61-864f-44af-94ec-dcb955fe583d tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 200 len: 345 microversion: 2.1 time: 1.076222 Jul 01 19:38:20.346185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 1/2] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:19 2022] GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 345 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:21.358525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b85434a6-d9f6-49cf-befb-882a08b367f6 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666cf280>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:21.445403 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b85434a6-d9f6-49cf-befb-882a08b367f6 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 200 len: 346 microversion: 2.1 time: 0.091269 Jul 01 19:38:21.446313 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:21 2022] GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:21.464902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b930e473-b615-4b91-8515-57e6cca08852 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Action: 'create', calling method: .version_select at 0x7f47666c01f0>, body: {"snapshot": {"volume_id": "58617b4f-1547-479e-a58a-fff22764befb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-728374427"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:21.780748 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b930e473-b615-4b91-8515-57e6cca08852 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.326046 Jul 01 19:38:21.781630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 2/4] 10.222.0.61 () {60 vars in 1161 bytes} [Fri Jul 1 19:38:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:21.792804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b6ce9ee0-b43c-4162-9bb5-e55c7c7c844b tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666cf5e0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:21.897729 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b6ce9ee0-b43c-4162-9bb5-e55c7c7c844b tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.109506 Jul 01 19:38:21.899138 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:21 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:21.909705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-374f3031-ce88-4e1c-8c32-2b233534d3d9 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666c0d30>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:21.974085 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-374f3031-ce88-4e1c-8c32-2b233534d3d9 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.068934 Jul 01 19:38:21.975195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 3/6] 10.222.0.61 () {58 vars in 1139 bytes} [Fri Jul 1 19:38:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:22.029793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-adaa3243-ae61-4e01-948e-dc2ba1e1efae tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666cfa60>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:22.050975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-adaa3243-ae61-4e01-948e-dc2ba1e1efae tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.068821 Jul 01 19:38:22.053310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:21 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:23.071235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f414f7aa-736f-427e-aeed-6d083ae9a719 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666c0280>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:23.163574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f414f7aa-736f-427e-aeed-6d083ae9a719 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.097821 Jul 01 19:38:23.164230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:23 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:24.185270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e0e7a9d5-519d-4ebe-93a9-91798c88d432 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666dc160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:24.254619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e0e7a9d5-519d-4ebe-93a9-91798c88d432 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.082520 Jul 01 19:38:24.261398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:24 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:25.268948 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9bce7889-5a78-48d6-b534-b320b62dc10c tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666c0160>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:25.346250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9bce7889-5a78-48d6-b534-b320b62dc10c tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.082024 Jul 01 19:38:25.357464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:25 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:26.366911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c7d1efb1-081e-4e09-a546-b6ea5aa95bb2 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666cfd30>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:26.463290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c7d1efb1-081e-4e09-a546-b6ea5aa95bb2 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.100544 Jul 01 19:38:26.464082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:26 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:27.476347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b1158d31-7a04-42a7-91ca-43a25e15f706 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666cd940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:27.549638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b1158d31-7a04-42a7-91ca-43a25e15f706 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.077580 Jul 01 19:38:27.559280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:27 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:28.562314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-df79a4ad-018a-492d-9e2e-5bf1d37488e1 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f47666c0310>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:28.628797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-df79a4ad-018a-492d-9e2e-5bf1d37488e1 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.071014 Jul 01 19:38:28.629374 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:28 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:38:29.022599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ae60e139-1322-4903-bf8c-74ebaa071481 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: .version_select at 0x7f47666cf1f0>, body: {"keypair": {"name": "tempest-keypair-1746256278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4XdTthJLROJW0fVobDCj6JUgii5yK+ax3LrAMSzxKAXWg+alvaNjySbl4yUPLvtacFqAFO2WtAC5dLk2TZlFJJKCSWH9RXnBh8XnRsV24rdCmI9DiChOdkRWKqh3eLPg=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:29.187418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-ae60e139-1322-4903-bf8c-74ebaa071481 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:29.218280 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-ae60e139-1322-4903-bf8c-74ebaa071481 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:29.270005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f824b3fb-da58-4be2-9c63-892a8d85c2ed tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: .version_select at 0x7f4766705e50>, body: {"keypair": {"name": "tempest-keypair-1220373568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuy16B9YbslXU0XNlDEigoA9NeUylYiuCoJXSlJLJAIvWWmJf7CW7a50VmhM4B1sKFsbHyi/RopOPyvMGcCfPetVD4FJDAo7HNHzLr20vCIQ73F2FoQQUEnEFbF57LcsQ=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:29.388954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ae60e139-1322-4903-bf8c-74ebaa071481 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.965794 Jul 01 19:38:29.390344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 7/14] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:38:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:29.422541 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f824b3fb-da58-4be2-9c63-892a8d85c2ed tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for project 21155f0418884af191e3e7981904730c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:29.440095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f824b3fb-da58-4be2-9c63-892a8d85c2ed tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for user c4167eeb95ca4a95a7db1c8e2491a411 and project 21155f0418884af191e3e7981904730c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:29.568877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f824b3fb-da58-4be2-9c63-892a8d85c2ed tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.456031 Jul 01 19:38:29.570961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 8/15] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:38:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:29.643239 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1f798655-4d53-4ec7-a2fc-d98d35908ed1 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f476663a820>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:29.717510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1f798655-4d53-4ec7-a2fc-d98d35908ed1 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 287 microversion: 2.1 time: 0.079872 Jul 01 19:38:29.722185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:29 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:29.729387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0fc22346-f034-4752-92b9-f8b4be04f575 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4766634790>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:29.898976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0fc22346-f034-4752-92b9-f8b4be04f575 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 202 len: 0 microversion: 2.1 time: 0.173435 Jul 01 19:38:29.899558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 9/17] 10.222.0.61 () {58 vars in 1253 bytes} [Fri Jul 1 19:38:29 2022] DELETE /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:38:29.908998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3b61a233-1d04-49ba-8ee6-6b7ce67efe3c tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f476663ae50>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:29.971815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3b61a233-1d04-49ba-8ee6-6b7ce67efe3c tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 200 len: 286 microversion: 2.1 time: 0.066182 Jul 01 19:38:29.976988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 9/18] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:29 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:30.985362 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb81040b-28dc-404e-9a20-2982b431afd8 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4766663550>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:31.018007 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-bb81040b-28dc-404e-9a20-2982b431afd8 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] HTTP exception thrown: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb81040b-28dc-404e-9a20-2982b431afd8 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Request method failure captured: Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 HTTP/1.1 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00oB_CWq4CGi1INA9rROCQ1kxCRygiyh9Y-kLo7DTNSBPOlfSf6uQx0spz-8EPjjwbq8g_ASfVpAQrrTzu1k3TpuFSTdyHVVf7Gfkzn2GIEKU6crdX8gG4NMUPK5PQeIbrrOqEq1yrTV8IE4QBRqn1PqufamGMHwXyaz8v9E58OCQ0 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:38:31.026219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_42651dd992524e1fb3aaed0cd268b783", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 889dd7d1ee484c698622dd3dd45b1bd1 Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'ed1acc53-6459-4caa-84d1-733bb4d7bf41'} Jul 01 19:38:31.027366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. (HTTP 404) (Request-ID: req-7e0e758d-c185-42f8-abf0-ce51ad21c4d2) Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.028067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:31.028975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 01 19:38:31.029921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. Jul 01 19:38:31.034918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:31.037885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb81040b-28dc-404e-9a20-2982b431afd8 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Returning 404 to user: Snapshot ed1acc53-6459-4caa-84d1-733bb4d7bf41 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:38:31.043881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb81040b-28dc-404e-9a20-2982b431afd8 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41" status: 404 len: 111 microversion: 2.1 time: 0.062598 Jul 01 19:38:31.049795 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 10/19] 10.222.0.61 () {58 vars in 1250 bytes} [Fri Jul 1 19:38:30 2022] GET /compute/v2.1/os-snapshots/ed1acc53-6459-4caa-84d1-733bb4d7bf41 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:38:31.064108 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d9db5aa1-f599-4bdd-ae22-f5c600794a64 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4766663ca0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:31.245173 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d9db5aa1-f599-4bdd-ae22-f5c600794a64 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 202 len: 0 microversion: 2.1 time: 0.193090 Jul 01 19:38:31.245905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 11/20] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:38:31 2022] DELETE /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:38:31.255463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e9cafdd9-3c3c-458f-8e35-fb8566c0f48a tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4765dc83a0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:31.380181 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e9cafdd9-3c3c-458f-8e35-fb8566c0f48a tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 200 len: 345 microversion: 2.1 time: 0.129758 Jul 01 19:38:31.381082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 12/21] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:31 2022] GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:31.426798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1078182101", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:31.620584 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] validate_networks() for [('68e50c5c-73f8-4467-8a5f-30c75d4029ae', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:38:32.393170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-062e5b86-7c85-4653-95de-2a9425cd04d7 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4766663c10>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:32.445279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-062e5b86-7c85-4653-95de-2a9425cd04d7 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] HTTP exception thrown: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-062e5b86-7c85-4653-95de-2a9425cd04d7 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Request method failure captured: Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb HTTP/1.1 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00oB_CWq4CGi1INA9rROCQ1kxCRygiyh9Y-kLo7DTNSBPOlfSf6uQx0spz-8EPjjwbq8g_ASfVpAQrrTzu1k3TpuFSTdyHVVf7Gfkzn2GIEKU6crdX8gG4NMUPK5PQeIbrrOqEq1yrTV8IE4QBRqn1PqufamGMHwXyaz8v9E58OCQ0 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:38:32.447830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_42651dd992524e1fb3aaed0cd268b783", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 889dd7d1ee484c698622dd3dd45b1bd1 Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '58617b4f-1547-479e-a58a-fff22764befb'} Jul 01 19:38:32.449045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. (HTTP 404) (Request-ID: req-b61ca828-7833-46c3-a40d-461fd3a05796) Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.449688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:32.451011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:38:32.451886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-062e5b86-7c85-4653-95de-2a9425cd04d7 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Returning 404 to user: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-062e5b86-7c85-4653-95de-2a9425cd04d7 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 404 len: 109 microversion: 2.1 time: 0.060788 Jul 01 19:38:32.452721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 13/22] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:32 2022] GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:38:32.461601 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8a59fb6b-0148-43fa-9e4d-b955b9ddeb19 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4765dc80d0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:32.516416 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-8a59fb6b-0148-43fa-9e4d-b955b9ddeb19 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] HTTP exception thrown: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8a59fb6b-0148-43fa-9e4d-b955b9ddeb19 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Request method failure captured: Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb HTTP/1.1 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00oB_CWq4CGi1INA9rROCQ1kxCRygiyh9Y-kLo7DTNSBPOlfSf6uQx0spz-8EPjjwbq8g_ASfVpAQrrTzu1k3TpuFSTdyHVVf7Gfkzn2GIEKU6crdX8gG4NMUPK5PQeIbrrOqEq1yrTV8IE4QBRqn1PqufamGMHwXyaz8v9E58OCQ0 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:38:32.518721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_42651dd992524e1fb3aaed0cd268b783", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 889dd7d1ee484c698622dd3dd45b1bd1 Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '58617b4f-1547-479e-a58a-fff22764befb'} Jul 01 19:38:32.519719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. (HTTP 404) (Request-ID: req-cc842ca6-d7ed-4ef9-a6c7-f20c0d81e16d) Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.520436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:38:32.521332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 19:38:32.522253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8a59fb6b-0148-43fa-9e4d-b955b9ddeb19 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Returning 404 to user: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8a59fb6b-0148-43fa-9e4d-b955b9ddeb19 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 404 len: 109 microversion: 2.1 time: 0.064658 Jul 01 19:38:32.523115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 14/23] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:38:32 2022] DELETE /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:38:32.536800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-586d4930-1709-496f-bf21-14a0424dc613 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Calling method '.version_select at 0x7f4766663160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:32.610774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-586d4930-1709-496f-bf21-14a0424dc613 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] HTTP exception thrown: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-586d4930-1709-496f-bf21-14a0424dc613 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Request method failure captured: Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb HTTP/1.1 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00oB_CWq4CGi1INA9rROCQ1kxCRygiyh9Y-kLo7DTNSBPOlfSf6uQx0spz-8EPjjwbq8g_ASfVpAQrrTzu1k3TpuFSTdyHVVf7Gfkzn2GIEKU6crdX8gG4NMUPK5PQeIbrrOqEq1yrTV8IE4QBRqn1PqufamGMHwXyaz8v9E58OCQ0 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:38:32.612885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/42651dd992524e1fb3aaed0cd268b783"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_42651dd992524e1fb3aaed0cd268b783", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 42651dd992524e1fb3aaed0cd268b783 Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269496769 Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 889dd7d1ee484c698622dd3dd45b1bd1 Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269496769-project Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '58617b4f-1547-479e-a58a-fff22764befb'} Jul 01 19:38:32.614042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. (HTTP 404) (Request-ID: req-6866340d-c290-41c9-b065-53cb0172890e) Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.614686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:32.615546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:38:32.616415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-586d4930-1709-496f-bf21-14a0424dc613 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] Returning 404 to user: Volume 58617b4f-1547-479e-a58a-fff22764befb could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:38:32.617314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-586d4930-1709-496f-bf21-14a0424dc613 tempest-VolumesSnapshotsTestJSON-269496769 tempest-VolumesSnapshotsTestJSON-269496769-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb" status: 404 len: 109 microversion: 2.1 time: 0.086114 Jul 01 19:38:32.625086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 15/24] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:32 2022] GET /compute/v2.1/os-volumes/58617b4f-1547-479e-a58a-fff22764befb => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:38:35.153251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:38:35.155303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:38:35.155897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:38:35.156417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:38:35.156938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:38:35.177400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:35.178616 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:35.179702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:35.180433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:35.239740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for project bd397adb95a6455b8e78db9b132d865e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:35.253614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for user bf5ff69a857f412fb65dce1b59a22e9d and project bd397adb95a6455b8e78db9b132d865e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:35.281239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:38:35.284597 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:38:35.456384 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8c35a251-594e-4ffd-9701-0e0e58461fb3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.528310 Jul 01 19:38:35.457394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 10/25] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:38:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:38:35.484278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eeac5c64-3b5c-4026-a167-c2aaa8db61d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:35.485063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eeac5c64-3b5c-4026-a167-c2aaa8db61d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:35.648364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eeac5c64-3b5c-4026-a167-c2aaa8db61d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:35.697620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eeac5c64-3b5c-4026-a167-c2aaa8db61d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1222 microversion: 2.1 time: 0.222101 Jul 01 19:38:35.698587 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 16/26] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:35 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1222 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:36.256115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-63128688", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:36.403252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] validate_networks() for [('68e50c5c-73f8-4467-8a5f-30c75d4029ae', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:38:37.516743 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1611705256", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b6a6bb7-8e95-46ce-aeac-814f0f95c869"}], "security_groups": [{"name": "tempest-securitygroup--1248222487"}], "key_name": "tempest-keypair-1220373568", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:37.923116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] validate_networks() for [('2b6a6bb7-8e95-46ce-aeac-814f0f95c869', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:38:38.315558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:38:38.317004 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:38:38.317514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:38:38.317975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:38:38.318426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:38:38.337279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:38.338023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:38.339077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:38.339679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:38.390152 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for project bd397adb95a6455b8e78db9b132d865e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:38.403237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for user bf5ff69a857f412fb65dce1b59a22e9d and project bd397adb95a6455b8e78db9b132d865e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:38.429684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:38:38.435742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:38:38.515338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-189fea0f-653d-4a42-a97f-e7a68e80dea9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.266949 Jul 01 19:38:38.518219 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 11/27] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:38:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:38:39.143487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c87fd205-c725-4a58-b8c0-f610373602bb tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Action: 'create', calling method: .version_select at 0x7f4765d90430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2081232418", "metadata": {"Type": "work"}}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:39.724641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:38:39.725923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:38:39.727100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:38:39.728223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:38:39.728841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:38:39.760434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:39.761281 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:39.775353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:39.777553 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:39.904719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for project 21155f0418884af191e3e7981904730c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:39.933907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for user c4167eeb95ca4a95a7db1c8e2491a411 and project 21155f0418884af191e3e7981904730c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:39.983846 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:38:39.991328 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:38:40.190179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c87fd205-c725-4a58-b8c0-f610373602bb tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.669717 Jul 01 19:38:40.191482 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 12/28] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jul 1 19:38:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 19:38:40.206740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1318588325", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bede229f-3edc-4006-b398-af17b8fdb00e"}], "security_groups": [{"name": "tempest-securitygroup--784972822"}], "key_name": "tempest-keypair-1746256278", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:40.232136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c2bcd84-1e91-413f-878d-ca00a05ed913 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.720815 Jul 01 19:38:40.232808 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 17/29] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:38:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:38:40.263195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fc5b3c2e-0822-4cd5-a5d8-9bc9c47f6697 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:40.267769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fc5b3c2e-0822-4cd5-a5d8-9bc9c47f6697 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:40.693094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fc5b3c2e-0822-4cd5-a5d8-9bc9c47f6697 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:40.710265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fc5b3c2e-0822-4cd5-a5d8-9bc9c47f6697 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1220 microversion: 2.1 time: 0.460394 Jul 01 19:38:40.712047 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 18/30] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:40 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1220 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:41.204277 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] validate_networks() for [('bede229f-3edc-4006-b398-af17b8fdb00e', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:38:41.476039 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0bb1450c-dd90-452d-ad18-778ae52c053c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'create', calling method: .version_select at 0x7f4765d24a60>, body: {"keypair": {"name": "tempest-keypair-345823398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp62zBzZnGt5c0UgI1Vi3vNSGHxwQiy4SFKTPFQRt0rTrAUS3CRu3Y3THMIy2qKhx0UWsB9DM4p44ohjgYG7ywYUH1tNeu2TfqIsHIFXWV3BBX5vmMbJ3zj5eum59SXkw=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:41.509381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-0bb1450c-dd90-452d-ad18-778ae52c053c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for project 9bc18901e30b4252988c065baa36be3c. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:41.526693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-0bb1450c-dd90-452d-ad18-778ae52c053c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for user b5040520134e464ea1d534767ea8728e and project 9bc18901e30b4252988c065baa36be3c. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:41.600120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0bb1450c-dd90-452d-ad18-778ae52c053c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.885403 Jul 01 19:38:41.608039 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 19/31] 10.222.0.61 () {62 vars in 1199 bytes} [Fri Jul 1 19:38:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 894 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 19:38:42.206481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-943224738", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "networks": [{"uuid": "2be4a9a2-fc46-486b-b7fe-35dbd7356da4"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:42.324198 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] validate_networks() for [('2be4a9a2-fc46-486b-b7fe-35dbd7356da4', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:38:45.623283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:38:45.623854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:38:45.624326 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:38:45.624745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:38:45.625195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:38:45.658269 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:45.662112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:45.669749 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:45.672535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:45.737140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:45.750860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:45.783679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:38:45.798241 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:38:45.954517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57061396-0113-4f69-bc6c-885a5a113e81 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.761674 Jul 01 19:38:45.964123 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 13/32] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:38:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 5772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:38:45.975433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b346c724-cfe4-4fae-8fba-f4d02babc2d5 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Calling method '.version_select at 0x7f4765d903a0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:46.121792 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b346c724-cfe4-4fae-8fba-f4d02babc2d5 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e" status: 200 len: 354 microversion: 2.1 time: 0.154928 Jul 01 19:38:46.123209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 14/33] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:45 2022] GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:46.144314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:46.155766 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:46.213352 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:46.216868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:46.218720 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:46.220673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.098667 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:47.167946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8617cf9c-801d-46d6-a4c3-aa0b7895246b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1296 microversion: 2.1 time: 1.036053 Jul 01 19:38:47.178466 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 15/34] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:46 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1296 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:47.190972 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:47.195793 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:47.224013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:47.227514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.231129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:47.233521 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.268563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:38:47.269904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:38:47.270557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:38:47.271107 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:38:47.271660 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:38:47.310178 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:47.314782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.323513 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:47.324024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.475188 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Getting quotas for project 66ecca1332d04a0faf9ccbb60f958e22. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:47.476176 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:47.498984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5a143308-5fe1-45ac-9843-a85aa079a3b4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1278 microversion: 2.1 time: 0.318898 Jul 01 19:38:47.499211 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Getting quotas for user 0b4c1e464c194939ac4ead76af5440fe and project 66ecca1332d04a0faf9ccbb60f958e22. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:47.500252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 16/35] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:47 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1278 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:47.508431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:47.510189 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:47.528010 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:47.528780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.531271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:47.532189 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:47.584095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:38:47.596577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:38:47.806200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b10dc2a2-c263-4aef-85a6-b0b92818b267 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.196622 Jul 01 19:38:47.809344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 20/36] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:38:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 6201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:38:47.825270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d2b071bd-6cb3-46dd-906d-2c83ef2ee519 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Calling method '.version_select at 0x7f4765d24310>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:47.977646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:47.987648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1e468271-c484-4e76-818d-e40ee19c4a57 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1246 microversion: 2.1 time: 0.485933 Jul 01 19:38:47.999869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 17/37] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:47 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1246 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:48.018652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4e62f614-37f3-495b-8c06-b0c381fb2aaa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:48.031026 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4e62f614-37f3-495b-8c06-b0c381fb2aaa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:48.053665 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d2b071bd-6cb3-46dd-906d-2c83ef2ee519 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e" status: 200 len: 354 microversion: 2.1 time: 0.240724 Jul 01 19:38:48.054310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 21/38] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:47 2022] GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:48.071441 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1eebb143-0da0-4485-b521-cb89006a5259 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Calling method '.version_select at 0x7f4765d24f70>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:48.304495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1eebb143-0da0-4485-b521-cb89006a5259 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e" status: 202 len: 0 microversion: 2.1 time: 0.237388 Jul 01 19:38:48.321707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 22/39] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:38:48 2022] DELETE /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:38:48.329827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:48.332531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:48.361535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:48.362185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:48.364385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:48.366173 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:48.578981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4e62f614-37f3-495b-8c06-b0c381fb2aaa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:48.628191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4e62f614-37f3-495b-8c06-b0c381fb2aaa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1214 microversion: 2.1 time: 0.629752 Jul 01 19:38:48.651703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 18/40] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:47 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1214 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:48.658927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b52b4f6d-7ee0-4ddc-8593-f0d9e83db6f0 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Calling method '.version_select at 0x7f4764c743a0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:48.863934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b52b4f6d-7ee0-4ddc-8593-f0d9e83db6f0 tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e" status: 200 len: 353 microversion: 2.1 time: 0.211013 Jul 01 19:38:48.864777 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 19/41] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:48 2022] GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:48.869806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:48.870651 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:48.884340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:48.884729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:48.891382 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:48.892075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:49.988001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:50.011858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-06f470da-7165-4fe1-af94-706753f7185d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 1.688941 Jul 01 19:38:50.015216 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 23/42] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:48 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:50.029021 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:50.030002 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:50.045161 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:50.045981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:50.048712 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:50.051081 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:50.607442 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:50.639334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bf8b3e34-f437-4710-a55f-e9e46db3e46c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 1.770301 Jul 01 19:38:50.654385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 20/43] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:48 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:50.670449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:50.673094 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:50.675346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:50.680795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:50.681411 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:50.683284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:50.683846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:50.995678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:51.017468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9832f905-e3a9-4c30-b931-82147af852ba tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1300 microversion: 2.1 time: 1.000877 Jul 01 19:38:51.018099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 24/44] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:50 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1300 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:51.033024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fe87b122-ee0b-45fc-bd53-b621f3cb1bfd tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Calling method '.version_select at 0x7f4764c4fca0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:51.123979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-fe87b122-ee0b-45fc-bd53-b621f3cb1bfd tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] HTTP exception thrown: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fe87b122-ee0b-45fc-bd53-b621f3cb1bfd tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Request method failure captured: Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e HTTP/1.1 Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv009m6X7Sm_qu2Gz9Mt798srMTW4Lat6HRH2vMXMY_Rs1HAfJRRShDPl00RiEAffH0vLaq--NXAaqzYrhmrHz2gIIip8qSuvfZCf3pfUF3EpXHQKSe2IlFr2TkZJHK33NGUh_uHYK_joJkWbBId5qkdxx9ln0lijiamKl5zru8dzlAE Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: b15a998f497440a89c4300f55401d1eb Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesGetTestJSON-910423322 Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:38:51.128295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b15a998f497440a89c4300f55401d1eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b15a998f497440a89c4300f55401d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b15a998f497440a89c4300f55401d1eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b15a998f497440a89c4300f55401d1eb", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesGetTestJSON-910423322 Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: b15a998f497440a89c4300f55401d1eb Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesGetTestJSON-910423322 Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesGetTestJSON-910423322-project Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 254f21b41fc34ee39ad5ed1c7a79dae6 Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesGetTestJSON-910423322-project Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '600cb103-836b-4b34-8788-fe87d0c67a7e'} Jul 01 19:38:51.130486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. (HTTP 404) (Request-ID: req-33abe055-d53e-4733-adbe-98e0b1cbec1d) Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:51.131366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:38:51.134823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:38:51.137139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. Jul 01 19:38:51.139613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:38:51.142429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fe87b122-ee0b-45fc-bd53-b621f3cb1bfd tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] Returning 404 to user: Volume 600cb103-836b-4b34-8788-fe87d0c67a7e could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:38:51.143668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fe87b122-ee0b-45fc-bd53-b621f3cb1bfd tempest-VolumesGetTestJSON-910423322 tempest-VolumesGetTestJSON-910423322-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e" status: 404 len: 109 microversion: 2.1 time: 0.124422 Jul 01 19:38:51.144990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 25/45] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:38:51 2022] GET /compute/v2.1/os-volumes/600cb103-836b-4b34-8788-fe87d0c67a7e => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:38:51.175150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:51.184431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:51.224912 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:51.226610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:51.230717 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:51.234340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:51.260929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:51.288699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-65da88d3-b591-47e8-9778-013d83eb98a6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1266 microversion: 2.1 time: 0.632753 Jul 01 19:38:51.292642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 21/46] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:50 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1266 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:51.667062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:51.667778 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:51.674429 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:51.674727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:51.678066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:51.679059 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:52.518570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:52.532683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0f20cef1-0e86-4594-becc-833a98b1e953 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 1.382465 Jul 01 19:38:52.543834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 26/47] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:51 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:52.551724 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:52.552895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:52.568277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:52.569890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:52.572990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:52.574017 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:52.911212 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:52.932200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:52.952850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b3a99870-ad61-4c4c-9645-00960c9721a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 1.289895 Jul 01 19:38:52.962235 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3c6249a3-8b65-4482-86c5-5508a8567fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1300 microversion: 2.1 time: 0.404290 Jul 01 19:38:52.962235 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 27/48] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:52 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1300 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:52.965195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 22/49] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:51 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:52.994929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:53.009479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:53.046227 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.046703 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.049231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.050207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.226240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:53.239057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-db638a9d-8d49-488b-91c6-df717f6dd9aa tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1272 microversion: 2.1 time: 0.272868 Jul 01 19:38:53.241782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 28/50] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:52 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:53.552713 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:53.553484 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:53.571025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.572071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.577275 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.580077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.685772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-a07d48a4-b0e0-4ef7-8f05-3e7e4d8ace83 req-9b618945-bd10-46f6-adc8-d8aa7933ddb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c757bfe-0ddd-4359-bde1-69dedd1a8fbf", "tag": "f799a0e5-d0ef-4240-a5d6-057c692e1daf"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:53.762103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a07d48a4-b0e0-4ef7-8f05-3e7e4d8ace83 req-9b618945-bd10-46f6-adc8-d8aa7933ddb0 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.762809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a07d48a4-b0e0-4ef7-8f05-3e7e4d8ace83 req-9b618945-bd10-46f6-adc8-d8aa7933ddb0 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.869075 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-a07d48a4-b0e0-4ef7-8f05-3e7e4d8ace83 req-9b618945-bd10-46f6-adc8-d8aa7933ddb0 service nova] Creating event network-changed:f799a0e5-d0ef-4240-a5d6-057c692e1daf for instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf on hv-cinder-83124 Jul 01 19:38:53.869815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a07d48a4-b0e0-4ef7-8f05-3e7e4d8ace83 req-9b618945-bd10-46f6-adc8-d8aa7933ddb0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 19:38:53.871241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.871919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.873576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:53.874214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:53.912742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.compute.rpcapi [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 19:38:53.913768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] Releasing lock "compute-rpcapi-router" {{(pid=124349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 19:38:53.987303 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d29846a2-60d0-4b9f-8bd6-9a618485792b None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398101 Jul 01 19:38:53.988308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 29/51] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:38:53.994381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:53.995184 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:54.023658 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:54.024114 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:54.024923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:54.025370 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:54.364337 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:54.377239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3323e10f-d34f-412e-8a36-508294a771ef tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.830227 Jul 01 19:38:54.379233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 23/52] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:53 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:54.385372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:54.386211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:54.392500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:54.393023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:54.393860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:54.394401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:55.083458 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:55.105304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8a602be8-579a-415b-a290-c09363ad130d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 1.115721 Jul 01 19:38:55.115436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 30/53] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:53 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:55.120412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:55.121036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:55.141411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:55.142714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:55.145437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:55.146285 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:55.262587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:55.283783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9338e33c-f05b-44c5-a8b9-ca7e7557d6ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.903188 Jul 01 19:38:55.285138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 24/54] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:54 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:55.291113 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-530383761", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceceb8fb-a9de-4f75-b2ed-1847f781916d"}], "security_groups": [{"name": "tempest-securitygroup--83590149"}], "key_name": "tempest-keypair-345823398", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:55.426013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:55.435769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7e906c81-0b14-482e-87b8-352b15e8ba2e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1272 microversion: 2.1 time: 0.318872 Jul 01 19:38:55.436502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 31/55] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:55 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:55.450760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:55.451723 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:55.460133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:55.461115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:55.462140 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:55.462781 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:55.652943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] validate_networks() for [('ceceb8fb-a9de-4f75-b2ed-1847f781916d', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:38:55.705536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:56.267742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:56.288142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-60d2a0cf-19b0-4adf-a9b3-875a8bb14b19 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.841339 Jul 01 19:38:56.289398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 32/56] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:55 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:56.463246 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-eeff2fc3-5e94-4fc5-83b0-0082d12e4a79 req-745d45e9-be7a-460b-bf1d-6c2790425bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061b75be-e4ba-4cb7-b74a-3373e5495283", "tag": "401375fd-18a5-4ae1-9ec2-8794947f178c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:56.484164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-eeff2fc3-5e94-4fc5-83b0-0082d12e4a79 req-745d45e9-be7a-460b-bf1d-6c2790425bd0 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.485733 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-eeff2fc3-5e94-4fc5-83b0-0082d12e4a79 req-745d45e9-be7a-460b-bf1d-6c2790425bd0 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.500132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-eeff2fc3-5e94-4fc5-83b0-0082d12e4a79 req-745d45e9-be7a-460b-bf1d-6c2790425bd0 service nova] Creating event network-changed:401375fd-18a5-4ae1-9ec2-8794947f178c for instance 061b75be-e4ba-4cb7-b74a-3373e5495283 on hv-cinder-83124 Jul 01 19:38:56.506215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-eeff2fc3-5e94-4fc5-83b0-0082d12e4a79 req-745d45e9-be7a-460b-bf1d-6c2790425bd0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215282 Jul 01 19:38:56.507500 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 33/57] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:56.513625 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:56.514672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:56.524409 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.525449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.527222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.528455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.800458 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:56.804520 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:38:56.805236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:38:56.805779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:38:56.806279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:38:56.806901 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:38:56.812512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4008375f-7442-447a-b05f-aa5ceb3738d8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.303521 Jul 01 19:38:56.813103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 34/58] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:56 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:56.817279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=25 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:56.819133 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.819788 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.821560 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.822744 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.830020 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:56.844192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for project 9bc18901e30b4252988c065baa36be3c. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:38:56.847388 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:56.849277 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for user b5040520134e464ea1d534767ea8728e and project 9bc18901e30b4252988c065baa36be3c. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:38:56.857429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.858686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.860280 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.861113 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.863087 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:38:56.866057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:38:56.919733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fe3d6a2e-9b9d-4688-8057-aa41ef0a97b7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.632849 Jul 01 19:38:56.920757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 25/59] 10.222.0.61 () {62 vars in 1187 bytes} [Fri Jul 1 19:38:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 19:38:56.925752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:56.926565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:56.939733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.940407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:56.941308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:56.941868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:57.085110 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:57.103228 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2a932743-74fd-4f9e-86fa-6dd43404f65b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.281460 Jul 01 19:38:57.103841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 35/60] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:56 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:57.120786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-77c096d2-4946-4210-bb90-dc02aa610f9f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:57.121393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-77c096d2-4946-4210-bb90-dc02aa610f9f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:57.188847 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77c096d2-4946-4210-bb90-dc02aa610f9f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:57.191423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:57.197832 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77c096d2-4946-4210-bb90-dc02aa610f9f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:57.200015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77c096d2-4946-4210-bb90-dc02aa610f9f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:57.201317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-77c096d2-4946-4210-bb90-dc02aa610f9f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1280 microversion: 2.20 time: 0.086284 Jul 01 19:38:57.201869 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 36/61] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:38:57 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:38:57.203280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-74061e51-f61d-4582-b8e7-ba6036289e9a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.280955 Jul 01 19:38:57.205179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 26/62] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:56 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:57.308561 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:57.309226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:57.316496 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:57.317461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:57.318485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:57.319223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:57.497704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:57.505515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c8d3d001-5e7c-41f8-a67e-3637357c96a7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.203001 Jul 01 19:38:57.506132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 37/63] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:57 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:57.829462 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:57.830119 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:57.836759 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:57.837220 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:57.838045 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:57.838511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.040662 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.051528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-550baff7-98ac-421f-afba-278f4d92eef7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.225980 Jul 01 19:38:58.052288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 27/64] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:57 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:58.122070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:58.123067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:58.130881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.131481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.132552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.133282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.222834 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:58.223710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:58.230306 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.230750 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.231527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.232237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.489363 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.497834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9425fbf9-4df2-4bf0-8281-8ea5a9a3dafc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.380961 Jul 01 19:38:58.498976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 38/65] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:58 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:58.511677 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:58.512688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:58.515337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:58.521467 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.522200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.523210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.523685 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.537965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.549361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1f9cb430-5709-422c-808a-24bbcf57c404 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.331339 Jul 01 19:38:58.549892 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 28/66] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:58 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:58.555942 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:58.556534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:58.563029 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.563478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.564225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.564649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.598607 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.609226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.610961 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.612072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f4f86ab2-669b-4a8f-b3f0-86566889d513 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1284 microversion: 2.20 time: 0.112011 Jul 01 19:38:58.612624 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 39/67] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:38:58 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:38:58.617175 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-af70129e-f72f-4a44-b920-5a0c48f09fe1 req-8d645e29-cf5f-4908-ab4e-c59d04463335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd8c337-77a5-4fd0-aeef-555fb1ad2d13", "tag": "3e673c64-9dd5-4928-8b69-9216037d8dde"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:38:58.625383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-af70129e-f72f-4a44-b920-5a0c48f09fe1 req-8d645e29-cf5f-4908-ab4e-c59d04463335 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:58.625818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-af70129e-f72f-4a44-b920-5a0c48f09fe1 req-8d645e29-cf5f-4908-ab4e-c59d04463335 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:58.636818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-af70129e-f72f-4a44-b920-5a0c48f09fe1 req-8d645e29-cf5f-4908-ab4e-c59d04463335 service nova] Creating event network-changed:3e673c64-9dd5-4928-8b69-9216037d8dde for instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 on hv-cinder-83124 Jul 01 19:38:58.642153 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-af70129e-f72f-4a44-b920-5a0c48f09fe1 req-8d645e29-cf5f-4908-ab4e-c59d04463335 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028367 Jul 01 19:38:58.643032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 40/68] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:38:58.714830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:58.724546 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-55489a35-0a01-4b3b-964d-2bd2f4db3611 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.173460 Jul 01 19:38:58.725191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 29/69] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:58 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:59.069479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:59.070357 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:59.076936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.077405 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.078444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.078617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.214069 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.224167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ce6648bb-cfad-46d3-baa0-3d09af13daa5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.158903 Jul 01 19:38:59.224845 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 41/70] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:59 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:59.517241 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:59.518322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:59.524532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.524984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.525814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.526278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.566877 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:59.567582 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:59.578209 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.578670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.579610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.580185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.604885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:59.743784 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.752889 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-02d2b93f-62b8-4f73-b735-e6e2e5c81ff4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.241049 Jul 01 19:38:59.754808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 30/71] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:59 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:59.758543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:59.759341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:59.767011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.767659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.768848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.769609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.795299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=87 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:59.798510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.806484 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4e8cb39a-98eb-4666-aa62-3d268ea7d0a2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.243919 Jul 01 19:38:59.815687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 42/72] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:59 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:38:59.815687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:38:59.815687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:38:59.818942 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.819400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.820175 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:38:59.820608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:38:59.847181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.856790 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.858350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.859716 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e25716f-3e63-4cc7-b48e-b14e776a9733 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1284 microversion: 2.20 time: 0.104933 Jul 01 19:38:59.861077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 31/73] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:38:59 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:38:59.977152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:38:59.984838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc5d07f6-5bb6-41d5-9eec-d9e4a982af9d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.176402 Jul 01 19:38:59.985402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 43/74] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:38:59 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:00.241040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:00.241744 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:00.249535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:00.250001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:00.250805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:00.251224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:00.388595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:00.397263 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6fbf3029-4d9b-41ba-8b88-94596f20dadc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.160233 Jul 01 19:39:00.398262 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 32/75] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:00 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:00.769594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:00.770327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:00.776702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:00.777234 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:00.778125 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:00.778633 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:00.825102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:00.825805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:00.832091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:00.832567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:00.833358 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:00.833785 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.009272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.013429 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.018511 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e3db599e-c365-4c35-a8e9-dd2e5e540c85 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.252725 Jul 01 19:39:01.019260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 44/76] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:00 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:01.024488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:01.025213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:01.031708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.032267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.033154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.033682 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.036476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c12021af-34aa-4961-9ab5-a63a7ceaad99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.216953 Jul 01 19:39:01.037080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 33/77] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:00 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:01.041641 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:01.042283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:01.049152 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.049636 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.050518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.050953 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.177615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.188424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.190410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.193071 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7572d576-9717-42c2-9ca3-0115e4c7c97e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1284 microversion: 2.20 time: 0.172062 Jul 01 19:39:01.193848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 45/78] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:01 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:01.344481 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.353276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e44359ca-fbb6-4896-a9c7-dabbb540715b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.315099 Jul 01 19:39:01.354078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 34/79] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:01 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:01.414074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:01.415171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:01.421871 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.422282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.423289 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.423718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.661273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:01.672347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-100945c1-e18a-4837-a2dd-549c29f75d3c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.262404 Jul 01 19:39:01.673233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 46/80] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:01 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:01.801178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-cfc52efc-377a-4d9c-87d0-a54abfd25906 req-7618b771-046e-4e80-8b46-5f54aafadaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46dff9c-709e-4bb6-b3ee-d2247114ec8c", "tag": "550bd6a9-51b7-49dd-8101-bc9890561ab1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:01.823034 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-cfc52efc-377a-4d9c-87d0-a54abfd25906 req-7618b771-046e-4e80-8b46-5f54aafadaf8 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.826591 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-cfc52efc-377a-4d9c-87d0-a54abfd25906 req-7618b771-046e-4e80-8b46-5f54aafadaf8 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.864738 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-cfc52efc-377a-4d9c-87d0-a54abfd25906 req-7618b771-046e-4e80-8b46-5f54aafadaf8 service nova] Creating event network-changed:550bd6a9-51b7-49dd-8101-bc9890561ab1 for instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c on hv-cinder-83124 Jul 01 19:39:01.865288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-cfc52efc-377a-4d9c-87d0-a54abfd25906 req-7618b771-046e-4e80-8b46-5f54aafadaf8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 19:39:01.866432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.867065 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.868024 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:01.868611 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:01.879450 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.compute.rpcapi [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 19:39:01.880539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] Releasing lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 19:39:01.900474 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-29f45c53-3bb8-4a15-aa6e-da11df2e5c37 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101847 Jul 01 19:39:01.901622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 35/81] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:02.028051 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-359b725d-1bdc-4cfc-8f62-4f41982fd7e0 req-e2f54625-e8fc-49ad-948c-9f15572f9177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b536cd-c30e-4d09-ac25-11cc3cff1d0d", "tag": "8019d8bc-d12d-47ba-91e0-87195457857a"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:02.041331 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-359b725d-1bdc-4cfc-8f62-4f41982fd7e0 req-e2f54625-e8fc-49ad-948c-9f15572f9177 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.041445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:02.041822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-359b725d-1bdc-4cfc-8f62-4f41982fd7e0 req-e2f54625-e8fc-49ad-948c-9f15572f9177 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.042157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:02.060191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-359b725d-1bdc-4cfc-8f62-4f41982fd7e0 req-e2f54625-e8fc-49ad-948c-9f15572f9177 service nova] Creating event network-changed:8019d8bc-d12d-47ba-91e0-87195457857a for instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d on hv-cinder-83124 Jul 01 19:39:02.067190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.067190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.067190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.067190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.071520 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-359b725d-1bdc-4cfc-8f62-4f41982fd7e0 req-e2f54625-e8fc-49ad-948c-9f15572f9177 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047548 Jul 01 19:39:02.072181 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 47/82] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:02.082274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:02.083202 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:02.090872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.091328 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.092111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.093100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.343714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.353932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.361395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b53f5adb-5e85-44b3-a87d-25324dd508ad tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.324401 Jul 01 19:39:02.361997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 36/83] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:02 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:02.362600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-50d9bb43-0eae-4442-b353-472e057d5a18 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.284264 Jul 01 19:39:02.363218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 48/84] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:02 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:02.367393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:02.368002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:02.374390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:02.374998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:02.379093 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.379548 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.380325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.380762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.380886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.381265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.382074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.382512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.471083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.479636 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.481143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.482306 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8e5e5f08-e9eb-4a0f-84e6-582a292f8ff3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1284 microversion: 2.20 time: 0.119004 Jul 01 19:39:02.482867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 37/85] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:02 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:02.535992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.543867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5187d940-d1fe-4123-b48b-2598fb03e8bd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.177112 Jul 01 19:39:02.544442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 49/86] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:02 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:02.690207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:02.690938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:02.698451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.698897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.700030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:02.700461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:02.846589 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:02.854621 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cbf2e848-ae41-4703-a98f-564e56e60280 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.169050 Jul 01 19:39:02.855204 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 38/87] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:02 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:03.378837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:03.379376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:03.379603 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:03.380225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:03.386118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.386565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.386671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.387023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.387489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.387810 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.388012 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.388263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.586929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:03.590164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:03.594648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-201c430d-c02b-4c55-b5ca-f0e961a1f696 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.219490 Jul 01 19:39:03.595224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 39/88] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:03 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:03.597849 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4177287f-7c4f-4bbc-9450-b1b05699b6a5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.222878 Jul 01 19:39:03.598616 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 50/89] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:03 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:03.599633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:03.600212 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:03.603764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:03.604772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:03.606042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.606642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.607534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.608218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.610890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.611333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.612121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.612546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.692970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:03.701764 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:03.703353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:03.704495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bba7e0c9-a390-4ced-8cd2-e0014f2d9b5d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1284 microversion: 2.20 time: 0.108328 Jul 01 19:39:03.705054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 40/90] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:03 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:03.760057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:03.768012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-79049d26-301e-4e66-8285-09a84720daab tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.168287 Jul 01 19:39:03.768595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 51/91] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:03 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:03.870688 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:03.871337 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:03.877819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.878300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:03.879065 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:03.879500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.015380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:04.023278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-95b3b128-eb3c-4e29-8210-d7464b5d274c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.156461 Jul 01 19:39:04.023855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 41/92] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:03 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:04.619276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:04.619871 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:04.620646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:04.620895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:04.622891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:04.627085 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.627528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.628284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.628501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.628717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.628941 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.629694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.630152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.823896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:04.827325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:04.831959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a7256db1-f294-4ae2-ba93-f1794b2be954 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.218963 Jul 01 19:39:04.832579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 52/93] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:04 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:04.835249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b346e903-8f57-4ae1-8747-28688b983de7 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.222278 Jul 01 19:39:04.835973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 42/94] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:04 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:04.837148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:04.837877 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:04.842226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:04.842798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:04.844287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.844689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.845444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.845873 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.848985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.849417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.850210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:04.850642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:04.919425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:04.927638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:04.929118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:04.930397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bae10de1-1f3a-49c7-9ee4-485cdb676d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1284 microversion: 2.20 time: 0.096842 Jul 01 19:39:04.930973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 53/95] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:04 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:05.006132 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:05.013792 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-75840a9e-a90f-402f-b019-277da9de68d5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.176640 Jul 01 19:39:05.014412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 43/96] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:04 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:05.041737 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:05.042381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:05.049579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:05.050050 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:05.050817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:05.051245 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:05.196189 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:05.204529 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2cb905ee-f540-4588-804e-65b34a28c9e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.166760 Jul 01 19:39:05.205097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 54/97] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:05 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:05.853929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:05.854861 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:05.855721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:05.856360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:05.861780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:05.862303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:05.862764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:05.863154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:05.863284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:05.863594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:05.864024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:05.864453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.055204 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.057477 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.066353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-86098c24-01ce-4f9b-b7c4-be46b75168af tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.216895 Jul 01 19:39:06.069724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f15f537-8c3d-4937-a828-8999bb0d6735 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.222870 Jul 01 19:39:06.077560 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 55/98] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:05 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:06.084986 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 44/99] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:05 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:06.085991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:06.091157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:06.091789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:06.092041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:06.099046 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:06.099696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.100605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:06.101214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.101853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:06.102463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.103327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:06.103852 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.204383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.212826 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.214415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.215590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-171d145b-c141-4b2c-bc76-87c38f599b53 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1276 microversion: 2.20 time: 0.136887 Jul 01 19:39:06.226377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 56/100] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:06 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:06.226377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:06.226377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:06.227211 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:06.227884 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.229044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:06.229044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:06.298569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.306167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-64034549-777a-42e6-9eb3-7e470a6639c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.219571 Jul 01 19:39:06.306788 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 45/101] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:06 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:06.364257 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:06.379538 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b495ea78-4f4b-4b60-b286-e9ba72b5ba1f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.161345 Jul 01 19:39:06.389684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 57/102] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:06 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:07.085189 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:07.085812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:07.087914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=5 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:07.089733 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:07.090690 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:07.094292 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.094846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.096154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.096778 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.097741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.098463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.099387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.100156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.193638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=26 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:07.289161 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.294013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.297243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4a691c8d-9f3a-40f2-9ca8-978dbc7f6006 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.216630 Jul 01 19:39:07.297830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 46/103] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:07 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:07.301972 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6a8b279e-dba6-48cc-bc33-affbfd57ca89 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.216994 Jul 01 19:39:07.302526 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:07.303512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 58/104] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:07 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:07.303636 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:07.309354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.309807 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.310573 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.311012 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.323249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:07.323885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:07.330575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.331026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.332779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.333337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.456735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.466372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.468287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.469417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-59b326ee-2a0d-4f1d-863d-ace7b26c1193 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1332 microversion: 2.20 time: 0.170616 Jul 01 19:39:07.470005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 47/105] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:07 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:07.474503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:07.475943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:07.484672 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.485519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.486707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:07.487143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:07.492202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:07.880419 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.884065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:07.889389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-226bcf25-21e1-44ee-91a1-a187026074db tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.569869 Jul 01 19:39:07.890133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 59/106] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:07 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:07.915295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:07.922707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d013ed07-30de-47c8-849c-956243291625 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.451621 Jul 01 19:39:07.923273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 48/107] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:07 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:08.318053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:08.319371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:08.320000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:08.320408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:08.327942 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.328394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.329317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.329761 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.329924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.330565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.331541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.332687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.538794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:08.542593 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:08.546565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-23c49319-7640-4eae-9cc4-09ea8a26fe9c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.231387 Jul 01 19:39:08.547138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 49/108] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:08 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:08.550762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a47debf8-2e11-4a53-8460-d08d77c25ad6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.239383 Jul 01 19:39:08.551428 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 60/109] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:08 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:08.559894 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:08.560508 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:08.566669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.567122 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.567882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.568425 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.631980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:08.640047 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:08.641545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:08.642691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bc2c3a26-82a5-4385-b57d-e34c09942090 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1340 microversion: 2.20 time: 0.094638 Jul 01 19:39:08.643259 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 50/110] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:08 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:08.906720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:08.907534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:08.914979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.915372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.916014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.916448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.940653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:08.941478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:08.948049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.948698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:08.950779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:08.951371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.105451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.114394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-41d1636e-8cee-4b1e-95d3-18d0725467f4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.211821 Jul 01 19:39:09.114976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 61/111] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:08 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:09.135216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.155911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dcd3f67f-7ee4-4e88-b03a-7e783f0ee142 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.217478 Jul 01 19:39:09.156692 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 51/112] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:08 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:09.567489 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:09.568119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:09.570605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:09.571321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:09.577488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:09.577965 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.578736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:09.579157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.579534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:09.579985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.580754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:09.581213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.767693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.770814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.777394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9e1c9454-ceea-4687-9d2f-79a29d47f87c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.215894 Jul 01 19:39:09.778568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 62/113] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:09 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:09.780821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b45417be-d8b6-48c4-88f3-b0db9567c596 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.216206 Jul 01 19:39:09.781385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 52/114] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:09 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:09.789218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:09.790054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:09.796253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:09.796700 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.797460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:09.797890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:09.858485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.866399 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.867876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:09.868973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7a00c506-5072-4abb-ad4d-89175818b79f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1340 microversion: 2.20 time: 0.089334 Jul 01 19:39:09.869566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 63/115] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:09 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:10.135220 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:10.136387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:10.143334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.143775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.144526 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.144954 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.173045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:10.173745 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:10.180612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.181074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.181828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.182377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.324905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:10.335619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c8b6111b-90b7-4f98-8639-9024562b9952 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.206764 Jul 01 19:39:10.336251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 53/116] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:10 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:10.347843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:10.355465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e4600e4e-d848-4500-8602-a4457549291e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.186326 Jul 01 19:39:10.356021 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 64/117] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:10 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:10.798985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:10.799933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:10.800818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:10.801825 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:10.810203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.810647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.811135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.811407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.811578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.811835 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:10.812348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:10.812784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.007764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.011727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.016873 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a179dad8-9dcd-47e2-9e2c-1c3794fd8799 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.222435 Jul 01 19:39:11.017424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 65/118] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:10 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:11.020667 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a9159ece-f1eb-4178-8356-d38995dafce2 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.228149 Jul 01 19:39:11.021243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 54/119] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:10 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:11.026436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:11.026436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:11.028751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:11.029198 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.029970 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:11.030394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.094201 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.102229 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.103775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.104888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-54183c58-637c-408d-95ec-61bf530a44bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1340 microversion: 2.20 time: 0.086361 Jul 01 19:39:11.105425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 66/120] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:11 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1340 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:11.357252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:11.358310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:11.368449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:11.369187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.370610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:11.371324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.374652 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:11.375342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:11.381962 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:11.382519 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.383366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:11.383875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:11.578142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.581384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:11.585816 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a772507c-98cc-425f-94e4-8b6924fd9fee tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.235692 Jul 01 19:39:11.586436 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 55/121] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:11 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:11.589242 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9205080b-068d-41cb-9dfc-73ed8c75008f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.219878 Jul 01 19:39:11.589803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 67/122] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:11 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:12.035007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:12.035652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:12.037599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:12.038076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:12.038423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:12.043893 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.044388 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.045233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.045352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.045712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.045839 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.046686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.047174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.242227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.247036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.251326 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-828032cf-7b8f-405c-864f-fd354b8564d8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.220587 Jul 01 19:39:12.251873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 56/123] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:12 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:12.254761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b9f90742-8a92-46d5-8e1c-e05e67a8c4ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.221465 Jul 01 19:39:12.255630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 68/124] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:12 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:12.257196 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:12.257811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:12.263839 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.264320 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.265079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.265511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.326771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.335006 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.336532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.337637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a5b0ecf2-322c-4b27-ad9f-1589655d8257 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1340 microversion: 2.20 time: 0.084820 Jul 01 19:39:12.338232 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 57/125] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:12 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1340 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:12.608472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:12.608696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:12.609074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:12.609294 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:12.615425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.615880 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.616423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.616657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.616937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.617106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.617705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:12.618265 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:12.806522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.810660 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:12.814570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bc58ca5b-51b6-4645-a479-15e7c2dc305c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.211192 Jul 01 19:39:12.815120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 58/126] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:12 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:12.818329 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f82f3cc2-e461-4401-a8c2-49045a9c08d6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.215485 Jul 01 19:39:12.818893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 69/127] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:12 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:13.269974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:13.270797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:13.273167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:13.274155 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:13.279283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.279928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.280943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.281522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.282241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.282831 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.283809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.284366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.474346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:13.477608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:13.482510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-89d3b315-08a9-4c3b-b013-41187efef1b6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.217750 Jul 01 19:39:13.483428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 59/128] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:13 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:13.485740 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-908d309b-6385-46b3-97cc-4ae691eab3e4 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.217694 Jul 01 19:39:13.486521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 70/129] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:13 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:13.487850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:13.488431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:13.497795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.498321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.499113 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.499528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.564305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:13.577164 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:13.579502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:13.581146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-67e925e9-117f-46f9-a7ae-ad3e38d79f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1340 microversion: 2.20 time: 0.096845 Jul 01 19:39:13.581919 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 60/130] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:13 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:13.835885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:13.836869 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:13.841747 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:13.842925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:13.847727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.848460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.850162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.850847 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.852812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.853571 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:13.855013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:13.855758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.045254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.049480 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.053195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-471b3e5b-2dac-48c0-b41f-165c28703b6e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.224106 Jul 01 19:39:14.053816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 71/131] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:13 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:14.058311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-26ae6f34-4825-4b11-8bea-e0f0384a2d28 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.223278 Jul 01 19:39:14.059094 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 61/132] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:13 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:14.500225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:14.500740 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:14.502924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:14.503504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:14.506956 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:14.507558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.508355 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:14.508779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.510073 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:14.510528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.511435 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:14.511879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.879994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.883486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.889822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ba67e969-864f-4156-914b-fbef2c7675f8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.393552 Jul 01 19:39:14.890694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 72/133] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:14 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:14.892032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-92837dba-2baf-40bb-8bc2-f17bac8f4d91 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.393038 Jul 01 19:39:14.892573 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 62/134] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:14 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:14.903297 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:14.903876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:14.910154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:14.910598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.911413 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:14.911843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:14.974003 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.981989 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.983494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:14.984669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-378083b2-ca5a-43f0-ae50-d5df76a7e46c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1340 microversion: 2.20 time: 0.085570 Jul 01 19:39:14.985233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 73/135] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:14 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:15.070052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:15.070710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:15.072593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:15.077015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:15.077587 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:15.079729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.080267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.081310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.081860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.084094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.084545 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.085338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.085776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.287872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:15.297626 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:15.298795 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d181378a-3e1b-4b30-ab32-f9a3a8411135 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.225874 Jul 01 19:39:15.299433 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 74/136] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:15 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:15.308595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-489f4cfa-9e2b-4ac1-8f9e-6245163a693b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.242387 Jul 01 19:39:15.309189 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 63/137] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:15 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:15.909817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:15.910932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:15.911317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:15.912092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:15.928685 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.929448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.929630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.930133 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.930734 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.930897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:15.931327 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:15.931641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.522418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.531682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.536146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:16.550109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0abb1a09-cb88-427e-89ae-aa9cf6814548 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.643549 Jul 01 19:39:16.552044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 64/138] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:15 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:16.559951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:16.560984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:16.566583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc0624dc-a6c5-4172-af8b-b737b5f7beec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.660161 Jul 01 19:39:16.567207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 75/139] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:15 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:16.583230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:16.583598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.585219 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:16.585927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.599123 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:16.599875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:16.622100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:16.627121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.629874 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:16.632860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.672852 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:16.698028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.710183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.713190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.714628 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-07bc6b4f-3f76-4b95-ad45-213cad3d6888 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1338 microversion: 2.20 time: 0.161443 Jul 01 19:39:16.715924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 65/140] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:16 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1338 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:16.723059 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:16.723901 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:16.730811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:16.731540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.732587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:16.733254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:16.923797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.934162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f52f9792-2898-4f04-98b8-5a9e9ba40795 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.363310 Jul 01 19:39:16.938609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 76/141] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:16 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:16.970772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:16.990812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4f9cb95f-c36b-4fc9-a2ac-303c880f8cb7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.272568 Jul 01 19:39:16.991412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 66/142] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:16 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:17.567748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:17.568561 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:17.575831 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.576395 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.577233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.577739 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.584799 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:17.585460 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:17.592524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.592980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.593752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.594246 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.789675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:17.801019 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:17.806069 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9249f6d3-5f44-461d-b1da-b62805559078 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.241644 Jul 01 19:39:17.815510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 77/143] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:17 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:17.818814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aa3dc6d2-b146-417f-919f-887521e99212 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.238343 Jul 01 19:39:17.820064 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:17.820696 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:17.827337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.827830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.828590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.828960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 67/144] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:17 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:17.829295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.951736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:17.952484 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:17.958274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:17.958788 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.959230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.959996 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:17.960430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:17.970162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:17.972130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:17.973322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-71f39f6a-c30a-4101-b893-28a476e083a2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.165389 Jul 01 19:39:17.984565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 78/145] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:17 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:18.009983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:18.010673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:18.018847 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:18.019498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:18.020462 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:18.021130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:18.146234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:18.167845 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-972f6042-0f2b-4b13-8237-a418f063bb8f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.220443 Jul 01 19:39:18.168447 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 68/146] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:17 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:18.191822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:18.200014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6f62f612-b768-4eb8-98dc-66f4390cfe8e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.195863 Jul 01 19:39:18.200610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 79/147] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:18 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:18.823289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:18.823911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:18.830612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:18.831055 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:18.832011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:18.832629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:18.837705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:18.838098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:18.845167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:18.845610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:18.846404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:18.846840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.032655 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.037307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.042634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9d1292ee-9ea5-4513-b549-1be264357e6e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.223232 Jul 01 19:39:19.043615 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 69/148] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:18 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:19.048744 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:19.049580 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:19.054851 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ed57abf2-bb87-49b0-9e53-a17cf79dfb04 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.222318 Jul 01 19:39:19.055782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:19.056482 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.057496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:19.058171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.066039 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 80/149] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:18 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:19.187869 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:19.189333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:19.203064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.204917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:19.206430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.208451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:19.209717 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.211312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.213402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.214727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f44e0ff8-a1d5-4472-a709-6d3531447edf tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.169628 Jul 01 19:39:19.215360 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 70/150] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:19 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:19.228399 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:19.229005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:19.235837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:19.245444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.247518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:19.247966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:19.415261 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.423154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ded44b5f-0ded-4752-9785-d61445a19a4d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.242304 Jul 01 19:39:19.423858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 81/151] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:19 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:19.442314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:19.450456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8d51ca0d-e785-4b56-9c3e-bd2530fad696 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.233702 Jul 01 19:39:19.451063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 71/152] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:19 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:20.066448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:20.066448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:20.071782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:20.072601 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:20.073503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.074008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.075217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.075714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.079146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.079647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.080410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.080837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.275108 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.283782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aada3de9-2a57-4a4b-b231-0e0fe87508fb tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.228283 Jul 01 19:39:20.284539 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 82/153] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:20 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:20.290116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:20.290722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:20.292052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.300079 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.300528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.301178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-65fa4dcd-a097-4977-b187-ec8ba852344a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.232589 Jul 01 19:39:20.302477 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.302915 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.310732 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 72/154] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:20 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:20.434643 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.440063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:20.440674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:20.444054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.445888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.446700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.447079 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2802b6b5-5eae-4b9c-9475-ed83d6a823bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.161493 Jul 01 19:39:20.447200 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.447630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 83/155] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:20 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:20.447937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.448566 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.467803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:20.468455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:20.475083 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.475749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.476723 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:20.477688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:20.672509 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.675780 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:20.681973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-40c12ba3-3039-4295-8dba-8af8b037b330 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.245739 Jul 01 19:39:20.682665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 73/156] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:20 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:20.683868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bfc3f873-79e9-40df-b9e4-dbcc90be215e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.220089 Jul 01 19:39:20.684458 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 84/157] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:20 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:21.304323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:21.306339 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:21.317217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.317915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.318229 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:21.318717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.318897 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:21.320052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.325725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.327325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.328094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.328520 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.531999 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:21.543851 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b8ef84bf-e9bb-43d9-8948-41d06ab46f6a tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.243956 Jul 01 19:39:21.547130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:21.558022 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 74/158] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:21 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:21.558402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-21ea40c1-aa41-40fa-aea4-bbff43bfa0fc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.242730 Jul 01 19:39:21.561374 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:21.562143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:21.562615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 85/159] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:21 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:21.569088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.569532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.570335 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.570767 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.700334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:21.701206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:21.709170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.709619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.710424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.710931 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.936319 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:21.940238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:21.950156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:21.950156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:21.950156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f8d8e82-0705-4d72-99ec-0b008cd97afb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.396803 Jul 01 19:39:21.950423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-593fb2e4-ce48-4993-bd67-ca4fc0e3f918 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.252316 Jul 01 19:39:21.950517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 75/160] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:21 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:21.950598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 86/161] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:21 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:21.953249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:21.953841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:21.960040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.960705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:21.961452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:21.961874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.096914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:22.104553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec85ad3c-b091-48ac-9504-c81a5ec59b1d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.155200 Jul 01 19:39:22.105041 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 76/162] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:21 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:22.565876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:22.566599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:22.573817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.574148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:22.574905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.575081 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:22.575386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.576104 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.582179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.582629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.583398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.583832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.772988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:22.776984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:22.780682 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-088ec67a-b8c2-427e-905e-d08b92a4a2ed tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.218698 Jul 01 19:39:22.781432 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 87/163] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:22 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:22.784520 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b4d14f1-34e9-45d6-a441-0c93433f0f1f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.214921 Jul 01 19:39:22.785082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 77/164] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:22 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:22.975816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:22.976035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:22.976439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:22.977053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:22.983240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.983848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.984423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.984835 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.985061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.985250 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:22.985820 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:22.986496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:23.184925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:23.185106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:23.194709 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:23.196502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:23.197465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-830666a6-611a-4173-a818-d6b5f6e8fa82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.225484 Jul 01 19:39:23.198049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6d6c48ee-1967-4451-a3a6-fb8efe2d8316 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.226082 Jul 01 19:39:23.198677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 78/165] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:22 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:23.208089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 88/166] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:22 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:23.211662 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:23.212416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:23.220734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:23.221177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:23.222292 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:23.222729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:23.393809 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:23.404597 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2eafc5f7-a3ac-4e0b-a959-bacbea16ca28 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.204217 Jul 01 19:39:23.405437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 79/167] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:23 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:23.406328 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-0c53397f-95ff-4b3e-a9f7-42464e14109b req-2e98bfa4-6f82-4758-9545-beb5b8bdba98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c757bfe-0ddd-4359-bde1-69dedd1a8fbf", "name": "network-vif-plugged", "status": "completed", "tag": "f799a0e5-d0ef-4240-a5d6-057c692e1daf"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:23.410212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:23.416557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-0c53397f-95ff-4b3e-a9f7-42464e14109b req-2e98bfa4-6f82-4758-9545-beb5b8bdba98 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:23.416991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-0c53397f-95ff-4b3e-a9f7-42464e14109b req-2e98bfa4-6f82-4758-9545-beb5b8bdba98 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:23.429919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-0c53397f-95ff-4b3e-a9f7-42464e14109b req-2e98bfa4-6f82-4758-9545-beb5b8bdba98 service nova] Creating event network-vif-plugged:f799a0e5-d0ef-4240-a5d6-057c692e1daf for instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf on hv-cinder-83124 Jul 01 19:39:23.434985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-0c53397f-95ff-4b3e-a9f7-42464e14109b req-2e98bfa4-6f82-4758-9545-beb5b8bdba98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103565 Jul 01 19:39:23.435573 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 89/168] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:39:23.720043 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1449726039", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "networks": [{"uuid": "83e98fcd-5ce9-45da-a8d6-fefc9a27caf0"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:23.777078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] validate_networks() for [('83e98fcd-5ce9-45da-a8d6-fefc9a27caf0', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:39:23.800092 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:23.800782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:23.811490 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:23.812155 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:23.813237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:23.813810 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.047074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.056826 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a19a3b16-42fc-42fd-ab2a-0c229ba085cf tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.262533 Jul 01 19:39:24.057521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 90/169] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:23 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:24.063342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:24.064212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:24.070469 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.070987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.071818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.072308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.292116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.303294 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-23e750a7-e535-4ce7-bc82-6959998b1dec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.244305 Jul 01 19:39:24.313339 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 91/170] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:24 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:24.318556 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:24.319143 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:24.325175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:39:24.325627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:39:24.326153 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:39:24.326268 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.326561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:39:24.326750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.326958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:39:24.327574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.328074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.338462 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.339260 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.340139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.340573 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.359561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Getting quotas for project fd410d5a356243c6b7b71cfb958fcdfc. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:39:24.363925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Getting quotas for user c8d8523e71264696997f23122115687a and project fd410d5a356243c6b7b71cfb958fcdfc. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:39:24.383553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:39:24.388325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:39:24.450633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6e2a0a78-a180-4c50-affd-87616e3bedfd tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734510 Jul 01 19:39:24.454113 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 80/171] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:39:24.460736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:24.461381 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:24.470639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.471088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.472322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.472322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.568941 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.579087 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9ad3862d-5fca-4ca1-90f6-1196f98b0ae8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.273859 Jul 01 19:39:24.579832 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 92/172] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:24 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:24.594837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:24.595568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:24.601988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.602606 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.604197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:24.604675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:24.688684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.699773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.700898 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.702229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3fe71c9e-ede5-4126-af2e-8a321e0a18d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.246935 Jul 01 19:39:24.703186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 81/173] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:24 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:24.708140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-99bc218f-7043-40e5-9fa6-be1904f62c78 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:24.708949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-99bc218f-7043-40e5-9fa6-be1904f62c78 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:24.794161 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.800387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:24.808044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-710ad44d-ee05-4d45-979a-e9e2402da7c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.218315 Jul 01 19:39:24.808710 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 93/174] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:24 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:24.810524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99bc218f-7043-40e5-9fa6-be1904f62c78 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:24.821740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-99bc218f-7043-40e5-9fa6-be1904f62c78 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1214 microversion: 2.1 time: 0.117200 Jul 01 19:39:24.822361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 82/175] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:24 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:25.075061 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:25.075722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:25.082878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.083327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.084112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.084624 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.249651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:25.257241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6ac85c39-912f-41e8-88d3-007e42740f6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.186983 Jul 01 19:39:25.257837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 94/176] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:25 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:25.321013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:25.321649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:25.329496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.330013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.330811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.331229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.334336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:25.462542 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:25.470215 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-738d70ed-d651-41fb-a848-1dbd6c2c87f1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.153317 Jul 01 19:39:25.470775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 83/177] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:25 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:25.596037 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:25.596760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:25.603106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.603590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.604350 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.604783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.722901 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:25.724238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:25.732904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.734185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.735439 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.735940 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.739404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:25.748747 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0bbd9030-2f52-40d9-9fef-5e673fc30fa4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.156527 Jul 01 19:39:25.749800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 95/178] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:25 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:25.824939 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:25.825612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:25.832220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.834065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.834065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.834065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.886183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:25.894724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:25.896227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:25.897344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4d9dd135-43db-497a-a555-fe26eaf59f18 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.180236 Jul 01 19:39:25.897905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 84/179] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:25 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:39:25.902796 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:25.903398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:25.909600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.910082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.910841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:25.911269 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:25.994728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:26.003429 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62b48f51-74a5-4573-a226-f7a6a38a1f3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1218 microversion: 2.1 time: 0.104145 Jul 01 19:39:26.004630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 85/180] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:25 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:26.029697 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:26.037078 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-42b26667-9ca8-4ef8-b247-c90f2b753351 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.216241 Jul 01 19:39:26.037638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 96/181] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:25 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:26.273925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:26.274559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:26.280850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.281306 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.282116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.282553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.416187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:26.423781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c1285dbe-75af-4f35-a23b-ea243211f472 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.153769 Jul 01 19:39:26.424349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 86/182] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:26 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:26.486676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:26.487372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:26.494250 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.494720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.495480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.495898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.630474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:26.638238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-651fda29-1caf-440e-9e8b-a12bcef2181a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.155500 Jul 01 19:39:26.638805 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 97/183] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:26 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:26.766550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:26.767415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:26.773499 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.773978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.774739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.775171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.908784 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:26.915720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:26.916406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:26.919053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5cfc5b6-4499-427f-a457-dd0867c1fa48 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.156536 Jul 01 19:39:26.920169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 87/184] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:26 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:26.922646 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.923063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:26.923876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:26.924301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.021006 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:27.021540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:27.027918 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.028369 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.029371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.030505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.073375 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.082917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.084501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.085728 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f5a6e979-74e8-4368-922e-8dd50634b49f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.173891 Jul 01 19:39:27.086414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 98/185] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:26 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:39:27.100420 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:27.101610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:27.108098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.108969 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.109848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.110187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.128290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.136874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dbba4d17-4fe8-4137-b336-893c418b9368 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1218 microversion: 2.1 time: 0.119747 Jul 01 19:39:27.137514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 88/186] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:27 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:27.242406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.249812 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0528aa22-ab50-49ae-8a08-0608ac29083a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.160697 Jul 01 19:39:27.250412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 99/187] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:27 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:27.441665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:27.442723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:27.449780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.450708 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.451459 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.452160 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.594465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.601822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-60d60436-f8dc-47da-bb89-3750c57cf9d3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.165090 Jul 01 19:39:27.602426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 89/188] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:27 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:27.657715 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:27.658375 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:27.664709 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.665159 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.665911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.666367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.814415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:27.822981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e4af62fa-3a3d-47b9-b684-bcb2f4991f15 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.170331 Jul 01 19:39:27.823679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 100/189] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:27 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:27.936462 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:27.937171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:27.943884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.944336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:27.945102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:27.945538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.074834 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.082433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b9e5209a-0547-4d6b-aabf-5a3927e4bf62 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.149892 Jul 01 19:39:28.082978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 90/190] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:27 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:28.104680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:28.105287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:28.111947 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.112392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.113154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.113584 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.153399 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:28.153987 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:28.160522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.160959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.161710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.162175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.232590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.240389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dde54d63-6848-43c7-a775-c0bfdca10975 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1218 microversion: 2.1 time: 0.090860 Jul 01 19:39:28.241201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 91/191] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:28 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:28.262533 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.268874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:28.269492 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:28.271491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.273202 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.274336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aa20b5e3-57a5-4b0e-b591-477a3ed08628 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.173588 Jul 01 19:39:28.275213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 101/192] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:28 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:28.275801 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.276303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.277363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.277972 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.415827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.425623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1aa9e7f5-942a-498f-b990-dd3f49e5cbcc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.160988 Jul 01 19:39:28.426219 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 92/193] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:28 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:28.623503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:28.624522 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:28.632594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.633047 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.633807 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.634268 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.777174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.789114 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-71b6ba5a-1751-49b3-a9b0-0f0e626834af tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.172087 Jul 01 19:39:28.789736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 102/194] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:28 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:28.840072 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:28.840765 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:28.847822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.848387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.849336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:28.850089 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:28.982392 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:28.990557 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-853ebf0b-42e5-4295-8fe3-952d00953403 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.154305 Jul 01 19:39:28.991126 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 93/195] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:28 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:29.099752 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:29.100353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:29.107113 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.107653 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.108344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.108813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.255138 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.256781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:29.257386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:29.262837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-63650c87-59bd-4792-b573-0896deeca736 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.166927 Jul 01 19:39:29.263371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 103/196] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:29 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:29.263863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.264381 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.265142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.265570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.292417 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:29.293008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:29.299332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.299776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.300579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.301009 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.328354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.336000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8f7ba464-2897-4e61-bf1c-f1b3939799f2 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1218 microversion: 2.1 time: 0.082987 Jul 01 19:39:29.336563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 94/197] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:29 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:29.428745 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.437003 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.438824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.439938 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3272bdc8-c9ea-438d-ab28-4279b176957c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.151314 Jul 01 19:39:29.440575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 104/198] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:29 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:39:29.442737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:29.443437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:29.450039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.450487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.451240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.451664 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.584069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.595875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a86830aa-6c20-40b4-a649-8703866618c4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.156818 Jul 01 19:39:29.596684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 95/199] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:29 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:29.809701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:29.810616 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:29.821787 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.822554 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.823865 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:29.824969 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:29.965082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:29.972630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3042d12e-a7f0-4feb-96e6-d7b39badc60c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.169587 Jul 01 19:39:29.973197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 105/200] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:29 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:30.007567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:30.008179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:30.014660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.015083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.015845 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.016277 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.158791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:30.167347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0bcec669-09c6-46e8-a8dd-571e2e80de2e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.163451 Jul 01 19:39:30.170236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 96/201] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:30 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:30.280632 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:30.281346 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:30.287525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.287977 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.288726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.289169 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.352878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:30.353379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:30.360088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.360986 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.362254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.362688 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.507178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:30.518308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f5cb540c-f74f-4d07-8afe-e0dc8dc49adc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1218 microversion: 2.1 time: 0.168918 Jul 01 19:39:30.520050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 97/202] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:30 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:30.526305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:30.527364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:30.540805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.541564 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.546223 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.549258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.628454 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:30.644260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0022bd95-4022-4e5b-ac61-6d6687d12f97 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.365608 Jul 01 19:39:30.646023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 106/203] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:30 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:30.652979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:30.654232 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:30.662999 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.664662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:30.672422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:30.672966 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.231563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.239968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.241676 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.243248 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b590169a-4150-4284-967b-d329acf517db tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.722023 Jul 01 19:39:31.244111 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 98/204] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:30 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:31.249095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:31.249992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:31.271691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.272366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.273353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.275389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.281237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.289384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-582d9928-20f7-45e5-8b9a-56be74c5e4b2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.641922 Jul 01 19:39:31.292549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 107/205] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:30 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:31.301437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:31.305638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:31.315868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.316331 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.317111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.322065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.607208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.610589 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:31.635567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b6b81b4-27ce-489e-93b7-ec8cc7394136 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.373878 Jul 01 19:39:31.636258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 99/206] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:31 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:31.657878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:31.658552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:31.671552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.675128 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.676504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.677857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.703462 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.716195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f323e96a-b85d-48e4-96cd-e75c655dc02c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.421912 Jul 01 19:39:31.717094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 108/207] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:31 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:31.732040 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-6d0d6ea5-e674-44d4-9212-f0c84f1455a3 req-e5cd3ce2-2be8-417b-bd75-c5663e49dd6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:31.745220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-6d0d6ea5-e674-44d4-9212-f0c84f1455a3 req-e5cd3ce2-2be8-417b-bd75-c5663e49dd6e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.745759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-6d0d6ea5-e674-44d4-9212-f0c84f1455a3 req-e5cd3ce2-2be8-417b-bd75-c5663e49dd6e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.770392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-6d0d6ea5-e674-44d4-9212-f0c84f1455a3 req-e5cd3ce2-2be8-417b-bd75-c5663e49dd6e service nova] Creating event network-changed:7ff227c5-7dfc-4476-b094-d71e27fb265f for instance fc929a10-068e-444f-bc59-ab78f9821237 on hv-cinder-83124 Jul 01 19:39:31.787277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-6d0d6ea5-e674-44d4-9212-f0c84f1455a3 req-e5cd3ce2-2be8-417b-bd75-c5663e49dd6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068736 Jul 01 19:39:31.794339 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 109/208] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:31.801635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:31.812081 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:31.826558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.829935 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.832547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:31.833100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:31.833701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:31.843894 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7cf99118-2283-434d-ad1a-b380fbd09ff3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1266 microversion: 2.1 time: 0.204455 Jul 01 19:39:31.844486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 100/209] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:31 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:32.002840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2cfdeef2-c431-4ee3-bfbb-60a751e3db9f req-ab76afc7-8e70-409e-93fa-9903d8c6a153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd8c337-77a5-4fd0-aeef-555fb1ad2d13", "name": "network-vif-plugged", "status": "completed", "tag": "3e673c64-9dd5-4928-8b69-9216037d8dde"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:32.003813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.011925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2cfdeef2-c431-4ee3-bfbb-60a751e3db9f req-ab76afc7-8e70-409e-93fa-9903d8c6a153 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.012391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2cfdeef2-c431-4ee3-bfbb-60a751e3db9f req-ab76afc7-8e70-409e-93fa-9903d8c6a153 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.013805 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1cbe4864-ef3b-4911-9802-2e86608b777f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.218113 Jul 01 19:39:32.015915 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 110/210] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:31 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:32.033552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2cfdeef2-c431-4ee3-bfbb-60a751e3db9f req-ab76afc7-8e70-409e-93fa-9903d8c6a153 service nova] Creating event network-vif-plugged:3e673c64-9dd5-4928-8b69-9216037d8dde for instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 on hv-cinder-83124 Jul 01 19:39:32.039231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2cfdeef2-c431-4ee3-bfbb-60a751e3db9f req-ab76afc7-8e70-409e-93fa-9903d8c6a153 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040020 Jul 01 19:39:32.040157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 101/211] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:39:32.265824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:32.266741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:32.276903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.277655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.278957 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.279679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.284277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:32.310675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:32.311420 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:32.318107 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.318600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.319419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.319857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.456554 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.466149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.467840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.469256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-95c6d40d-ea29-4f66-8f33-b6255db6b437 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.210081 Jul 01 19:39:32.469818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 111/212] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:32 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:32.486486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.494324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-93321c90-5da1-44f1-972a-1f1865e6cff6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.187794 Jul 01 19:39:32.494899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 102/213] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:32 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:32.653077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:32.653673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:32.660320 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.660761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.661507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.661932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.732974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:32.733578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:32.739842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.740289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.741046 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.741477 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.815364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.823292 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2cb08456-02bb-4b8f-9b6b-8455de030175 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.174184 Jul 01 19:39:32.823875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 112/214] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:32 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:32.861474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:32.861993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:32.868471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.868949 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.869712 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:32.870186 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:32.879198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.886905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e18e53f2-07f4-41b8-85a5-961f3afff354 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.157947 Jul 01 19:39:32.887474 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 103/215] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:32 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:32.935312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:32.942817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5120b1b5-9149-4c48-81f8-40800687f6e8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1266 microversion: 2.1 time: 0.085909 Jul 01 19:39:32.943372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 113/216] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:32 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:33.032415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:33.033027 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:33.039543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.039991 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.040758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.041187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.175112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:33.183488 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a02b5396-ba53-4dd9-bf1b-758f3dd6db8c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.155129 Jul 01 19:39:33.184052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 104/217] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:33 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:33.487367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:33.487971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:33.495067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.495709 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.496510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.497087 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.510805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:33.512071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:33.514333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:33.525921 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.526403 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.527216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.527647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.713165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:33.717733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:33.725493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9c44a83b-c5d3-4ef0-9c1b-e4ad7e80019b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.218546 Jul 01 19:39:33.726073 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 105/218] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:33 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:33.729773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:33.731435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:33.732655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1b6613e6-0063-4d4c-8a8a-36ab04205e09 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.249239 Jul 01 19:39:33.733267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 114/219] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:33 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:33.844904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:33.845740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:33.852380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.852822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.853751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.854359 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.904241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:33.904857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:33.912544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.912994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:33.913779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:33.914239 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.240713 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:34.248815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-005f1d35-1d86-4f74-82ff-c33ff0a11332 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.407888 Jul 01 19:39:34.249464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 106/220] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:33 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:34.256502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:34.264606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:34.265705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:34.269875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-96e7cc78-d4b0-4225-8a24-522eab73d52c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.369615 Jul 01 19:39:34.272289 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 115/221] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:33 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:34.274475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.275182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.276148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.276873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.279186 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:34.279806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:34.289324 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.289708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.290903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.291488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.349624 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:34.398296 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:34.410036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e051cac0-8bb6-47bf-8a3d-e9e49f10bf09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1266 microversion: 2.1 time: 0.158557 Jul 01 19:39:34.414602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 107/222] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:34 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:34.466367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:34.474224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-df475dc6-f9e0-4ab9-be34-90afbf2d4243 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.200943 Jul 01 19:39:34.483491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 116/223] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:34 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:34.744036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:34.744036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:34.751406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:34.752032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:34.763282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.765311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.765786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.766681 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.766987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.767772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:34.768233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.772494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:34.819717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=8 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:35.041040 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.051500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.051889 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.054104 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.056510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d69fe16-f3d5-45e6-b130-209ae594a111 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.309508 Jul 01 19:39:35.057213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 117/224] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:34 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:35.071348 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c7cba36e-eaad-4045-8f0a-b8803722306e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.333024 Jul 01 19:39:35.072006 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 108/225] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:34 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:35.266263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:35.267024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:35.273924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.274637 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.275609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.276124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.289590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:35.290357 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:35.300243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.310037 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.310967 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.311521 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.524208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.525076 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.531974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3a6a337d-b956-4011-9eb8-04bb8dd41639 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.246304 Jul 01 19:39:35.532872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 109/226] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:35 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:35.534117 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f1a1c83c-e458-4a40-b157-7dd9d61c9982 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.271854 Jul 01 19:39:35.537734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:35.538544 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:35.545238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 118/227] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:35 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:35.549053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:35.549726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:35.550230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.551038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.552539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.552984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.573393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.574577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.575459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:35.576230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:35.622881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.631870 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b2d65a63-1ded-48b9-a98e-17e2757ded69 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1266 microversion: 2.1 time: 0.097750 Jul 01 19:39:35.632911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 110/228] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:35 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:35.746753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:35.756391 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-59bccf7e-b34c-4c6c-b20d-acf211b5908c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.211425 Jul 01 19:39:35.757287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 119/229] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:35 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:36.075694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:36.076301 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:36.085603 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.086084 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.086862 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.087454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.089692 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:36.090404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:36.097292 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.097815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.098739 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.099239 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.290504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:36.302289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:36.303325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:36.304541 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:36.305911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fba7eb27-6645-43bf-be2f-9bb7f8257548 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.234920 Jul 01 19:39:36.319998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 111/230] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:36 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:36.324673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-25ee96d9-51c9-4ba5-bd86-ae6edb272ebf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.238718 Jul 01 19:39:36.325255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 120/231] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:36 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:36.549103 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:36.549717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:36.550838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:36.551867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:36.556187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.559793 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.560455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.561001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.561412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.561893 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.562515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.563147 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.816694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:36.818384 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:36.826559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8884bbbb-e9bf-48bb-8646-7dfe744b201a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.281680 Jul 01 19:39:36.827771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 112/232] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:36 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:36.832313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:36.832986 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:36.836859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f30785c5-6100-4477-abeb-6af81ec9a189 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.289514 Jul 01 19:39:36.838402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 121/233] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:36 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:36.845183 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:36.846027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:36.847917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.848388 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.849247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.849689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.854235 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.854752 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:36.855574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:36.856275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.153594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:37.165333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1dacd391-1155-4a9f-b87b-ce8da5f14d3a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1266 microversion: 2.1 time: 0.335634 Jul 01 19:39:37.166920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 113/234] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:36 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:37.219277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:37.227398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f39ea092-e322-4b19-b824-d062ff1e04e8 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.387578 Jul 01 19:39:37.228053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 122/235] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:36 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:37.328460 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:37.328993 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:37.336007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.336464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.337298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.337980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.343345 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:37.343959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:37.357270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.357716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.359441 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.361262 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.722932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:37.731476 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:37.733985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:37.735931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:37.738030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4168752b-ef17-4442-b42c-7ceb4e94dcf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.414466 Jul 01 19:39:37.739216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 114/236] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:37 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:37.747907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d4a5639f-41e7-492a-8254-8a34e325bde9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.409255 Jul 01 19:39:37.749149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 123/237] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:37 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:37.843947 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:37.844794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:37.851184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.852051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.853031 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.853674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.855234 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:37.856236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:37.865708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.866497 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:37.867284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:37.867719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.137110 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:38.146451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9f6ab7eb-c8c5-4d89-a54e-2fb11dcf6b1e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.295446 Jul 01 19:39:38.147140 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 124/238] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:37 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:38.156913 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:38.165283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ee6479c2-de5b-4743-ad27-1bb8ffe440c5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.325164 Jul 01 19:39:38.167314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 115/239] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:37 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:38.183660 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:38.185332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:38.186304 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-44937e76-1963-458f-84e5-379dfec13756 req-30ff29c6-817b-4bbb-b129-b604c65f0a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46dff9c-709e-4bb6-b3ee-d2247114ec8c", "name": "network-vif-plugged", "status": "completed", "tag": "550bd6a9-51b7-49dd-8101-bc9890561ab1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:38.194256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.194717 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.196460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.196907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.198820 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-44937e76-1963-458f-84e5-379dfec13756 req-30ff29c6-817b-4bbb-b129-b604c65f0a23 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.199711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-44937e76-1963-458f-84e5-379dfec13756 req-30ff29c6-817b-4bbb-b129-b604c65f0a23 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.213225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-44937e76-1963-458f-84e5-379dfec13756 req-30ff29c6-817b-4bbb-b129-b604c65f0a23 service nova] Creating event network-vif-plugged:550bd6a9-51b7-49dd-8101-bc9890561ab1 for instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c on hv-cinder-83124 Jul 01 19:39:38.219950 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-44937e76-1963-458f-84e5-379dfec13756 req-30ff29c6-817b-4bbb-b129-b604c65f0a23 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037351 Jul 01 19:39:38.220873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 116/240] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:39:38.247427 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:38.249331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:38.260109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.261210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.266783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.267433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.268010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:38.282463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4e31d5cf-1996-4718-9c46-97daee17ab8a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1274 microversion: 2.1 time: 0.102913 Jul 01 19:39:38.289594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 125/241] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:38 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:38.400032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:38.402559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:38.409506 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-390617fb-1bc2-4972-8525-9e10cb23bb7f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.168112 Jul 01 19:39:38.410102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 117/242] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:38 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:38.758089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:38.759656 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:38.764797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:38.765523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:38.769599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.770440 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.771358 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.772071 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.774167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.775529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.778640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:38.779864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:38.999401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.003213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.007488 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e465901-706e-43b7-a1a4-21b44551c288 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.246480 Jul 01 19:39:39.008228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 118/243] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:38 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:39.012708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.014274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.015381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aa8c74dd-1fa5-49f5-8cfa-d68207e22dce tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.262691 Jul 01 19:39:39.016096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 126/244] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:38 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:39.163774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:39.171483 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:39.178001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.178291 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.179070 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.179505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.183578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:39.191156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:39.208730 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.209367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.210440 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.211032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.406775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.413748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.414872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7ba8fb16-7e47-4a0d-8b9b-4fa47b413aa1 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.254840 Jul 01 19:39:39.415430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 119/245] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:39 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:39.417145 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:39.422283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:39.422903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:39.424322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c8c99611-ba75-40ba-8b71-3e8e02b873e3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.244521 Jul 01 19:39:39.424925 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 127/246] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:39 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:39.429427 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:39.429692 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.430036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:39.430167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.430946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.431382 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.436060 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.436507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.437304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:39.437735 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:39.501734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.509443 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-97b3a164-095e-456c-8efd-1c4be1666ee0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1274 microversion: 2.1 time: 0.092922 Jul 01 19:39:39.510076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 120/247] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:39 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:39.586666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:39.608999 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d0d8ea7f-b5a4-44e3-897c-c95c97a60e98 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.182794 Jul 01 19:39:39.609562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 128/248] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:39 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:40.028505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:40.029465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:40.037500 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:40.038628 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:40.039773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.040511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.041754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.042480 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.047773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.048194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.048983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.049364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.240232 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.243562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.248664 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3370a69b-99b8-4626-af64-16eacfcc942e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.226707 Jul 01 19:39:40.249225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 121/249] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:40 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:40.254566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.256205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.257332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b33f3a31-93a7-42c3-b32d-2f895621bdf5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.226323 Jul 01 19:39:40.257867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 129/250] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:40 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:40.436301 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:40.437132 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:40.442241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:40.442878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:40.443569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.444013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.444780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.445214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.449412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.449886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.450662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.451096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.643883 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.647035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.652228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1828bedc-5a1c-4077-a40f-219d7647b409 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.222543 Jul 01 19:39:40.652772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 122/251] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:40 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:40.654767 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-707537b0-6be3-4e72-aa39-28c6fff88ec9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.216468 Jul 01 19:39:40.658087 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 130/252] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:40 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:40.658218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:40.658218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:40.663561 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:40.663977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.664364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:40.664517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.665170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.665607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.671210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.672080 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.672962 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:40.673402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:40.761280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.769131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90e0a75b-e8ac-44ea-9f90-55053487e19e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1274 microversion: 2.1 time: 0.115173 Jul 01 19:39:40.769702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 123/253] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:40 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:40.826930 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:40.834907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c7f73ee5-e30a-420d-8813-3ed7f816d590 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.178256 Jul 01 19:39:40.835501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 131/254] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:40 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:41.271284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:41.271284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:41.280125 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:41.280892 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.281057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.281523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:41.281827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.282315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.289205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.289861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.290889 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.291581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.473036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.477711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.484285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e7bb5470-c3e0-44f4-a695-2215d1525063 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.221064 Jul 01 19:39:41.485019 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 124/255] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:41 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:41.488236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.489742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.490879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4a8e5117-2b1b-49dc-b132-e10f3a425290 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.217952 Jul 01 19:39:41.491434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 132/256] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:41 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:41.674976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:41.675478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:41.676043 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:41.676668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:41.683471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.684105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.684772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.685092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.685293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.685583 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.686236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.686671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.885445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.890010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.893154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3156a8b6-3544-41a9-be0c-a339db35b315 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.224315 Jul 01 19:39:41.893764 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 125/257] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:41 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:41.898061 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6e560888-c766-4cac-8334-98b34e2df38b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.227367 Jul 01 19:39:41.898364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:41.907653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:41.907854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 133/258] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:41 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:41.907854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:41.907854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:41.908098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.908098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.908098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.908098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.911363 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.911823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.912811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:41.913372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:41.978238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:41.986117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dfa500a2-87ee-43a5-8b0c-436d7d257fbe tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1274 microversion: 2.1 time: 0.091237 Jul 01 19:39:41.986896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 126/259] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:41 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:42.065093 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:42.072583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-501b9965-7b3e-4224-b8c6-88d687d26917 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.172587 Jul 01 19:39:42.073123 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 134/260] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:41 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:42.504568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:42.505811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:42.516235 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:42.516842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:42.516976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.517309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.518139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.518572 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.522920 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.523338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.524092 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.524557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.726322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:42.731336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:42.735945 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3cdcfc7d-b531-4f2f-9133-05bbf7d6c53d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.238091 Jul 01 19:39:42.736524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 127/261] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:42 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:42.740930 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:42.742489 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:42.743599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e97abba2-c10c-4118-ae15-506ed865d452 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.234373 Jul 01 19:39:42.744165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 135/262] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:42 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:42.912907 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:42.913584 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:42.916623 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:42.917332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:42.920349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.920872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.921715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.922247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.924260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.924694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:42.925436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:42.925856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.120001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.123355 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.127657 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d897f039-0371-45c3-ba4b-39ef012b30b8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.219655 Jul 01 19:39:43.128233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 128/263] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:42 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:43.131585 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4aefd4ae-6792-4760-a7cb-b8fdd43f8ef3 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.220106 Jul 01 19:39:43.141038 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 136/264] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:42 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:43.141183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:43.141183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:43.141183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.141183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.141497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.141497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.145157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:43.145963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:43.152378 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.152827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.153587 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.154052 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.210979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.219302 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6bee5e6f-4bdd-432e-b6ee-b7187ad659c4 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1274 microversion: 2.1 time: 0.090067 Jul 01 19:39:43.219885 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 129/265] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:43 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:43.297544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.305094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-37720764-b4f2-4eb1-b282-6df6cb87fe6a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.171720 Jul 01 19:39:43.305661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 137/266] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:43 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:43.757253 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:43.758279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:43.765237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:43.766277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:43.767773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.768226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.768996 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.769430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.772563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.773004 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.773765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:43.774222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:43.960055 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.964598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.971120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-30435bd2-4dac-41ee-b6fc-66daf1c0152c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.219852 Jul 01 19:39:43.971858 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 130/267] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:43 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:43.975099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.976742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:43.977835 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-77c13975-2c21-40ca-a292-cb9cbbce5fd1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.219583 Jul 01 19:39:43.978410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 138/268] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:43 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:44.145620 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:44.147527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:44.149068 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:44.149859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:44.155790 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:44.157884 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.158418 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.158570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.159233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.159699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.159826 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.161146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.161897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.377426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:44.384956 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a99879de-5aab-4e3b-9d37-5d941d060c96 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.244473 Jul 01 19:39:44.389701 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 131/269] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:44 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:44.393038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:44.393692 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:44.398893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:44.399868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.400311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.401079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.401505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.406575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4bb09de3-20e8-4ca7-b77a-32eb6de8e0e5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.261700 Jul 01 19:39:44.407174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 139/270] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:44 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:44.411545 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-f4ffbbcd-7d4d-485e-b013-1b9ed9f355b7 req-1ab77e74-2ba9-40df-b9c0-b5fe289d7877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061b75be-e4ba-4cb7-b74a-3373e5495283", "name": "network-vif-plugged", "status": "completed", "tag": "401375fd-18a5-4ae1-9ec2-8794947f178c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:44.420135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f4ffbbcd-7d4d-485e-b013-1b9ed9f355b7 req-1ab77e74-2ba9-40df-b9c0-b5fe289d7877 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.420576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f4ffbbcd-7d4d-485e-b013-1b9ed9f355b7 req-1ab77e74-2ba9-40df-b9c0-b5fe289d7877 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.432887 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-f4ffbbcd-7d4d-485e-b013-1b9ed9f355b7 req-1ab77e74-2ba9-40df-b9c0-b5fe289d7877 service nova] Creating event network-vif-plugged:401375fd-18a5-4ae1-9ec2-8794947f178c for instance 061b75be-e4ba-4cb7-b74a-3373e5495283 on hv-cinder-83124 Jul 01 19:39:44.438826 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-f4ffbbcd-7d4d-485e-b013-1b9ed9f355b7 req-1ab77e74-2ba9-40df-b9c0-b5fe289d7877 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030751 Jul 01 19:39:44.439420 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 140/271] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:44.444643 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:44.445333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:44.452702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.453180 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.455820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:44.455820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:44.487067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:44.495017 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-03f225ce-6f5a-4b0e-be64-15602586d07d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1274 microversion: 2.1 time: 0.108312 Jul 01 19:39:44.495588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 132/272] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:44 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:44.591751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:44.603018 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-93e37fca-be16-4d23-a303-04cd95f054b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.162123 Jul 01 19:39:44.603577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 141/273] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:44 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:44.990738 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:44.991519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:44.998249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:44.999177 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:45.000255 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.000802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.001691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.002175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.005795 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.006260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.007041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.007479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.197192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:45.204581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:45.205232 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e57a319e-8970-4ef1-9195-730570ab2e70 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1320 microversion: 2.1 time: 0.220083 Jul 01 19:39:45.205800 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 133/274] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:44 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:45.212601 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:45.214133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:45.215244 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-299860d9-e1f6-46dc-8d45-41e8074dc1a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.222552 Jul 01 19:39:45.215823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 142/275] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:44 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:45.405273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:45.406359 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:45.416743 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.417533 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.418852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.419539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.425684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:45.426319 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:45.432640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.433091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.433983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.434446 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.436876 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:45.863779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:45.869156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:45.877361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-39fb3dcc-4fc5-49de-a1c5-01e2e040c84c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.478543 Jul 01 19:39:45.879600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e2c8046b-0e91-48ad-9eec-fd9b548697ef tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.457551 Jul 01 19:39:45.879756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 134/276] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:45 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:45.880671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 143/277] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:45 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:45.886198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:45.890459 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:45.891473 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:45.892086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:45.904821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.904821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.905077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.905077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.905271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.905271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:45.905436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:45.905436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.006550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:46.014455 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-930ff807-9888-4b21-a2ef-0fabad705d20 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1272 microversion: 2.1 time: 0.135029 Jul 01 19:39:46.015038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 135/278] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:45 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:46.076761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:46.084501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-01dd6be4-7ad2-42db-9410-152b436aafa3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.202663 Jul 01 19:39:46.085086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 144/279] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:45 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:46.222405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:46.223716 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:46.232788 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:46.233392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:46.241624 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.243674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.244279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.245208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.245880 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.246703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.247139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.251123 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.255990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:46.845701 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:46.855964 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8563d29-a7c5-40c8-8e2c-02535d76c3ed tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1513 microversion: 2.1 time: 0.637534 Jul 01 19:39:46.857379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 136/280] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:46 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1513 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:46.871599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:46.879178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:46.880052 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:46.880719 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:46.881763 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:46.883133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9a716f7f-c0c3-4b34-9354-ca173ce56255 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.654482 Jul 01 19:39:46.883875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 145/281] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:46 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:46.894604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.896350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.898649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.899512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.902537 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:46.903166 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:46.909885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.910850 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.912393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:46.912967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:46.989074 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lazy-loading 'flavor' on Instance uuid 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:39:47.093385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:47.102544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-81971739-023a-411f-9af2-c1d325366666 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.206156 Jul 01 19:39:47.103129 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 146/282] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:46 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:47.108830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:47.110136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:47.116784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.117232 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.118064 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.118489 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.154675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-12593569-cf40-4a88-a8ce-26040dcec399 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf/action" status: 200 len: 32 microversion: 2.1 time: 0.282742 Jul 01 19:39:47.158106 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 137/283] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:39:46 2022] POST /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:39:47.163329 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:47.164033 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:47.170239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.170690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.171445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.171931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.320058 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:47.329417 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2bb578cd-2c83-4da6-a2b4-00b3f87f7d6c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.225087 Jul 01 19:39:47.330034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 147/284] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:47 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:47.335112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:47.335710 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:47.341836 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.342351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.343276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.343890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.351545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:47.359591 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cf29a064-769b-4e78-b783-3f05e5dd9289 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.200286 Jul 01 19:39:47.360789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 138/285] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:47 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:47.366072 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:47.367079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:47.373341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.373986 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.374903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.375479 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.559787 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:47.562339 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:47.568400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ce0e6b98-c454-4953-b42e-b842b09e2cdb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.206159 Jul 01 19:39:47.578032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 139/286] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:47 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:47.578195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-28a8d4f8-bbb7-48b8-a7b8-abd391b7d50e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.238703 Jul 01 19:39:47.579598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 148/287] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:47 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:47.905002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:47.906360 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:47.913502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.914271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:47.914994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:47.915432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.044171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:48.052577 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:48.054294 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:48.055494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62ed6a10-5e2a-449f-af65-18e26f7b0356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.154792 Jul 01 19:39:48.056427 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 140/288] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:47 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:48.119168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:48.119768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:48.125761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.126275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.127031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.127453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.299265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:48.325306 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e2069e23-09bf-424b-a522-19fbb68a5125 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.209985 Jul 01 19:39:48.326070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 149/289] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:48 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:48.346535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:48.347472 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:48.354114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.354556 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.355885 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.356476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.375982 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:48.376597 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:48.382925 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.384256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.385420 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.386105 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.668430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:48.676361 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-508054e5-c5c4-46ad-9b27-01814794a370 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.304193 Jul 01 19:39:48.683549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:48.684437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 150/290] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:48 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:48.691099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-55b35a13-4710-4615-8a7b-13b17638d970 req-d3c4dac2-46a8-4bcb-b78b-0d7a72b372f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b536cd-c30e-4d09-ac25-11cc3cff1d0d", "name": "network-vif-plugged", "status": "completed", "tag": "8019d8bc-d12d-47ba-91e0-87195457857a"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:48.699791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4ee4d5fe-0b4a-40e4-86f8-654d580612d7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.356907 Jul 01 19:39:48.700380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 141/291] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:48 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:48.700524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-55b35a13-4710-4615-8a7b-13b17638d970 req-d3c4dac2-46a8-4bcb-b78b-0d7a72b372f2 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.701095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-55b35a13-4710-4615-8a7b-13b17638d970 req-d3c4dac2-46a8-4bcb-b78b-0d7a72b372f2 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.706324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:48.707143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:48.712793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-55b35a13-4710-4615-8a7b-13b17638d970 req-d3c4dac2-46a8-4bcb-b78b-0d7a72b372f2 service nova] Creating event network-vif-plugged:8019d8bc-d12d-47ba-91e0-87195457857a for instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d on hv-cinder-83124 Jul 01 19:39:48.717726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-55b35a13-4710-4615-8a7b-13b17638d970 req-d3c4dac2-46a8-4bcb-b78b-0d7a72b372f2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030687 Jul 01 19:39:48.718408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 151/292] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:48.725300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.725715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.729010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:48.729769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:48.730900 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.732951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.742149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.743124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.744273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:48.744860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:48.987312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:49.002030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:49.005809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6b92bb32-af0f-4168-879b-39ea7eed0f2a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1364 microversion: 2.1 time: 0.278640 Jul 01 19:39:49.010939 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 152/293] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:48 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:49.011018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8c5a6ca9-cdb2-4fd6-b494-cc585fe758a7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.307589 Jul 01 19:39:49.011360 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 142/294] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:48 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:49.075294 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:49.075904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:49.082658 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.083193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.083950 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.084371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.137064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-6c8aa16f-f47b-4bdc-892b-a19764144160 req-919af5b8-2787-4c6a-ba45-f6ddcd36be1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54552177-8284-492d-b816-ff15c8d350bb", "tag": "696cb842-33cd-4a72-9d6c-9d14350288fe"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:49.150222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6c8aa16f-f47b-4bdc-892b-a19764144160 req-919af5b8-2787-4c6a-ba45-f6ddcd36be1e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.150665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6c8aa16f-f47b-4bdc-892b-a19764144160 req-919af5b8-2787-4c6a-ba45-f6ddcd36be1e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.162163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-6c8aa16f-f47b-4bdc-892b-a19764144160 req-919af5b8-2787-4c6a-ba45-f6ddcd36be1e service nova] Creating event network-changed:696cb842-33cd-4a72-9d6c-9d14350288fe for instance 54552177-8284-492d-b816-ff15c8d350bb on hv-cinder-83124 Jul 01 19:39:49.167490 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-6c8aa16f-f47b-4bdc-892b-a19764144160 req-919af5b8-2787-4c6a-ba45-f6ddcd36be1e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034870 Jul 01 19:39:49.168317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 143/295] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:39:49.233401 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:49.245554 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:49.248803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:49.250413 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-08f8c7e0-f44e-490a-921d-8a69bee7843d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.179565 Jul 01 19:39:49.251515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 153/296] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:49 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:49.344161 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:49.344928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:49.351323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.351932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.352514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.352971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.482961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:49.490492 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85bb4ad5-55c4-450e-8806-e1ae4a69849d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1367 microversion: 2.1 time: 0.151401 Jul 01 19:39:49.491104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 144/297] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:49 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:49.701103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:49.701720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:49.707980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.708404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.709225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.709665 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.716648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:49.717256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:49.723441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.723890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:49.724653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:49.725085 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.012337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.023559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.027220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-23305d52-a9e5-41d9-88da-4523808ca7b3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.329973 Jul 01 19:39:50.028385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 154/298] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:49 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:50.034190 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:50.035076 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:50.041729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-50e30a5d-bd47-4829-849a-a977054abba9 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.328828 Jul 01 19:39:50.042100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.042774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.043285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 145/299] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:49 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:50.043687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.044126 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.053770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:50.062117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:50.068422 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.068873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.069659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.070147 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.275638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.283200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-79034de1-1d15-4aaf-a5fe-1572dc3fec77 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1549 microversion: 2.1 time: 0.253481 Jul 01 19:39:50.283785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 155/300] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:50 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:50.288274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:50.288886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:50.293187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.301159 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.301606 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.302486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.302842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.303317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-59a9a31b-a55f-4e75-a998-822374655da2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.258984 Jul 01 19:39:50.311534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 146/301] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:50 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:50.319712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:50.320209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:50.327503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.327958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.328726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.329199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.434485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7323e935-b836-49cd-b16d-cf99818a4e56 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121340 Jul 01 19:39:50.435401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 147/302] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:39:50 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:50.488867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.497543 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.499357 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.500634 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e49bedf6-58e1-4041-8398-8f619c62d407 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.215961 Jul 01 19:39:50.501574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 156/303] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:50 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:50.508022 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:50.508871 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:50.516009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.516794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.517891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.518576 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.678201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:50.686193 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-801cb8ee-f640-48d0-800d-d2e468a90046 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1558 microversion: 2.1 time: 0.182725 Jul 01 19:39:50.690568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 148/304] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:50 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:50.708361 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:50.708930 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:50.717230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.718049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.718829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:50.719263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:50.865561 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-877a5514-a0c5-437a-9bd7-2cee77ee238e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161900 Jul 01 19:39:50.866554 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 157/305] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:39:50 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:51.047406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:51.048331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:51.059394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:51.059998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:51.065457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.066735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.067666 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.068463 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.078495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.080586 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.081599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.082807 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.544707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:51.557998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e0943b97-7a34-4c4c-83e1-a3ab8a4cd857 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.502810 Jul 01 19:39:51.559503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 158/306] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:51 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:51.562931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:51.565461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:51.566907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:51.574811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.575493 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.578102 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.579063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.581370 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c3623229-7cc7-4cf3-bbee-1b3f7bbb8b08 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.537942 Jul 01 19:39:51.582106 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 149/307] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:51 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:51.594118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:51.594821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:51.611757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.612199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.612970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:51.613398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:51.635041 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:52.414577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:52.426295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:52.455535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bd137f91-686d-4683-bce2-9c9f724609d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.894370 Jul 01 19:39:52.456669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 159/308] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:51 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:52.464813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:52.466361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:52.466602 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-d9690741-6157-40a3-abfa-244d47a8e607 req-72926247-fa1c-40ea-ad78-64731eecc005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd8c337-77a5-4fd0-aeef-555fb1ad2d13", "tag": "3e673c64-9dd5-4928-8b69-9216037d8dde"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:52.467496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-59137897-9b68-4200-a4aa-166f09d9f3a8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.884639 Jul 01 19:39:52.468369 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 150/309] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:51 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:52.480460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d9690741-6157-40a3-abfa-244d47a8e607 req-72926247-fa1c-40ea-ad78-64731eecc005 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:52.482671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d9690741-6157-40a3-abfa-244d47a8e607 req-72926247-fa1c-40ea-ad78-64731eecc005 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:52.516754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-d9690741-6157-40a3-abfa-244d47a8e607 req-72926247-fa1c-40ea-ad78-64731eecc005 service nova] Creating event network-changed:3e673c64-9dd5-4928-8b69-9216037d8dde for instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 on hv-cinder-83124 Jul 01 19:39:52.526088 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-d9690741-6157-40a3-abfa-244d47a8e607 req-72926247-fa1c-40ea-ad78-64731eecc005 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067992 Jul 01 19:39:52.526922 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 160/310] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:52.577110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:52.577782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:52.604707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:52.607023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:52.615419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:52.617173 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:52.617992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:52.619085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:52.619411 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:52.619941 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:52.620305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:52.620755 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:53.107995 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:53.116183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-54b564f7-5a5f-481e-bcc0-4ffb7ee428ba tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.544527 Jul 01 19:39:53.127884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 151/311] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:52 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:53.180429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:53.192583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a2b12308-32e6-4c9b-80e7-6564ae63231b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.598431 Jul 01 19:39:53.193235 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 161/312] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:52 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:39:53.393012 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-78778859-3b9c-4937-a28d-56a45afe7085 req-f4e92789-f8af-4f1f-b7e2-acec923b3c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46dff9c-709e-4bb6-b3ee-d2247114ec8c", "tag": "550bd6a9-51b7-49dd-8101-bc9890561ab1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:39:53.401984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-78778859-3b9c-4937-a28d-56a45afe7085 req-f4e92789-f8af-4f1f-b7e2-acec923b3c52 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:53.402678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-78778859-3b9c-4937-a28d-56a45afe7085 req-f4e92789-f8af-4f1f-b7e2-acec923b3c52 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:53.414464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-78778859-3b9c-4937-a28d-56a45afe7085 req-f4e92789-f8af-4f1f-b7e2-acec923b3c52 service nova] Creating event network-changed:550bd6a9-51b7-49dd-8101-bc9890561ab1 for instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c on hv-cinder-83124 Jul 01 19:39:53.419936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-78778859-3b9c-4937-a28d-56a45afe7085 req-f4e92789-f8af-4f1f-b7e2-acec923b3c52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030701 Jul 01 19:39:53.421040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 152/313] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:39:53.472764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:53.473371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:53.479829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:53.480470 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:53.481614 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:53.482226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:53.492053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:53.492576 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:53.499425 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:53.500113 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:53.500930 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:53.501651 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:53.690293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:53.699927 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-704e030c-c66e-45a4-ba08-3dae2d54d374 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.231290 Jul 01 19:39:53.701216 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 162/314] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:53 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:53.733478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:53.745752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:53.747463 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:53.748635 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3687aee1-1b0b-46fe-a0fc-9bd5b6e34923 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.265697 Jul 01 19:39:53.749200 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 153/315] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:53 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:39:54.134611 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:54.135311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:54.142250 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.143742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.144786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.145350 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.173536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:54.210301 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:54.210821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:54.217107 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.217544 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.218542 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.219125 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.589873 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:54.594479 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:54.598213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-16c93875-03f2-463a-b7c5-cd9d0ec12152 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.467390 Jul 01 19:39:54.602917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b64821bc-098d-4a84-b827-59b3e3cd309e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.396692 Jul 01 19:39:54.606520 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 154/316] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:54 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:54.612181 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 163/317] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:54 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:54.716922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:54.717549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:54.719670 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:54.726851 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.727540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.728366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.728762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.766714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:54.767488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:54.774248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.774953 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.775745 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:54.776141 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:54.908621 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:54.917133 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9b52492e-fb95-436b-b9da-8d0ae63d7de7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.204150 Jul 01 19:39:54.917715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 155/318] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:54 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:54.942779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:54.950992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:54.952494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:54.953577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6eeebebe-9ea5-48f2-8a55-12d50389d04b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.191108 Jul 01 19:39:54.954220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 164/319] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:54 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:39:55.621004 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:55.621226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:55.621550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:55.621833 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:55.628184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.628349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.628630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.628786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.629400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.629539 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.629837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.630005 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.824450 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:55.827332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:55.834262 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-23e06822-88a9-41da-b5ee-d563d607caa8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.217087 Jul 01 19:39:55.835055 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 156/320] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:55 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:55.836089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a3ca3ab4-7c23-4c98-a7f6-69bc57d11550 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.218993 Jul 01 19:39:55.836621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 165/321] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:55 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:55.934752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:55.935352 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:55.942210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.942668 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.943394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.943858 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.971979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:55.972600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:55.979223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.979678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:55.980452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:55.980890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:56.131659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:56.139632 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4c999d64-87a8-43a4-88bd-f802cac1b152 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.208812 Jul 01 19:39:56.140168 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 157/322] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:55 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:56.159431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:56.167721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:56.169241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:56.172040 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3d50f4d-918c-41b3-861d-d12f6c0f84b6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.203845 Jul 01 19:39:56.172630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 166/323] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:55 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:56.852417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:56.853095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:56.853264 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:56.853754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:56.860456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:56.860934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:56.861100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:56.861382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:56.861702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:56.862170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:56.863105 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:56.863541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:57.056823 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:57.060612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:57.064976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c3b8766-62f0-470c-a64e-9efec0691a6d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.216729 Jul 01 19:39:57.065617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 158/324] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:56 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:57.068908 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-967cfedf-1640-4333-b20a-c2c2ac6a3b3c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.219496 Jul 01 19:39:57.069467 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 167/325] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:56 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:57.160085 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:57.160859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:57.167735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:57.168185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:57.168941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:57.169375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:57.190093 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:57.190726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:57.197168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:57.197629 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:57.198411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:57.198844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:57.376374 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:57.384583 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b4b7b555-6430-4002-a087-311a7ba66b4c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.230378 Jul 01 19:39:57.385095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 159/326] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:57 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:57.387511 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:57.396381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:57.397963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:57.399081 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d51f1974-d75a-4d12-8187-c66f8a7819d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.212992 Jul 01 19:39:57.399628 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 168/327] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:57 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:58.082737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:58.083319 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:58.085886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:58.087016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:58.089925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.090407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.091307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.091723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.093360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.093811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.094698 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.095085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.295265 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:58.298886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:58.305067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-17081b9b-453b-44af-9f95-6abc93517a16 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.226393 Jul 01 19:39:58.305734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 160/328] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:58 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:58.307050 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8c8a4880-2aa0-40a7-bde0-c7d3d687701d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.225045 Jul 01 19:39:58.307676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 169/329] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:58 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:58.401079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:58.401675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:58.409261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.409705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.410623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.410988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.417133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:58.417833 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:58.424148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.424579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.425578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:58.426106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:58.575223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:58.588290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:58.589784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:58.590984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ccc014a3-7108-4c97-9079-2acfae54fc7f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.177830 Jul 01 19:39:58.592177 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 170/330] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:58 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:58.692229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:58.700610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-64e3c02c-cbd6-4317-be9e-b8ee21543c91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.303633 Jul 01 19:39:58.701179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 161/331] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:58 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:59.322617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:59.323314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:59.329842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:59.330351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.330517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:59.330625 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.331403 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.331864 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.339451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.339894 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.340659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.341102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.535817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:59.539266 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:59.543511 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f84faeeb-a593-4b3a-8079-071b5a3d7b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.224959 Jul 01 19:39:59.544076 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 171/332] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:59 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:59.547118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85605d0a-bb26-42ea-8195-1a83a505eca7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.221419 Jul 01 19:39:59.547669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 162/333] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:59 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:39:59.610182 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:59.610895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:59.617771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.618255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.619009 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.619592 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.717734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:39:59.718643 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:39:59.725194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.725646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.726460 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:39:59.726899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:39:59.747599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:59.755667 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:59.757153 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:59.758257 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-511be3d6-c18f-431d-877d-b0ddae488c86 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.152322 Jul 01 19:39:59.759180 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 172/334] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:39:59 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:39:59.860501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:39:59.868495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-52187a51-266d-4763-9991-466a8197d2cb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.154806 Jul 01 19:39:59.869218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 163/335] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:39:59 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:00.567317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:00.568167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:00.569510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:00.570577 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:00.579231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.580180 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.581354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.581459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.581831 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.581936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.582597 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.583051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.785384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:00.787970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:00.793136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ca24aeeb-51af-47fa-bc15-281378f3dcb5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.233166 Jul 01 19:40:00.793679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 173/336] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:00 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:00.795486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b088def4-a79b-47eb-a880-ffcc783aaae8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.233735 Jul 01 19:40:00.796210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 164/337] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:00 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:00.798157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:00.798757 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:00.804714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.805158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.805935 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.806384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.884934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:00.885684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:00.892038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.892481 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.893234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:00.893694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:00.977927 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:00.986081 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:00.987706 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:00.988791 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-25ac86e4-8684-4ee9-857c-9c13853a1362 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.194137 Jul 01 19:40:00.989340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 174/338] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:00 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:01.035138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:01.043178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8091954-0e96-4d5c-9cb4-88efae4bd018 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.162139 Jul 01 19:40:01.043740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 165/339] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:00 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:01.814586 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:01.815383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:01.815383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:01.816145 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:01.824212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:01.824442 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:01.824825 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:01.825045 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:01.825987 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:01.826186 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:01.826646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:01.826855 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:02.025611 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:02.030070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:02.037032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1b3eceb6-cde0-42f9-be7a-82c6118f4208 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.228147 Jul 01 19:40:02.037384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-16fc1d11-4042-47b0-a5c1-bde66d610889 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.228525 Jul 01 19:40:02.038105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 166/340] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:01 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:02.038330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 175/341] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:01 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:02.051396 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:02.052053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:02.065215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:02.065779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:02.070599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:02.070599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:02.071344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:02.075261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:02.075434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:02.075434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:02.075434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:02.075434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:02.094078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:02.282281 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:02.288686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:02.294101 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:02.296299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d860a835-bdef-4140-a82e-3289a6cfea9b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.240167 Jul 01 19:40:02.297064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:02.297198 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 176/342] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:02 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:02.298428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0bc0ac82-66a0-4260-aad5-6efad337054b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.250746 Jul 01 19:40:02.299203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 167/343] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:02 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:03.054285 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:03.054848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:03.055148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:03.055792 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:03.061282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.061722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.062143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.062519 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.062659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.062942 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.063344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.064061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.260115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:03.263264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:03.267629 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c5ec7c9-c5b7-439e-ab37-3e6d4e6b89e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.217548 Jul 01 19:40:03.268197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 177/344] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:03 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:03.271386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8c17c2e9-e046-4620-8566-19cbc5901d78 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.220126 Jul 01 19:40:03.271947 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 168/345] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:03 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:03.314215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:03.314822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:03.316323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:03.316940 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:03.321773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.322246 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.323017 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.323426 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.324444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.324887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.325671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:03.326151 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:03.517594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:03.521388 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:03.525765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-881d1f1b-0812-4e66-bcdb-a98626c3963d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.216049 Jul 01 19:40:03.526491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 178/346] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:03 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:03.529798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:03.531445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:03.534173 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e924a95-1b8e-4251-ad8a-1345b80caafa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.220209 Jul 01 19:40:03.534715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 169/347] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:03 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:04.289132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:04.289857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:04.291202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:04.291812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:04.296990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.297753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.298432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.298617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.298850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.298966 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.299644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.300072 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.495995 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:04.499380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:04.503943 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-48b0fb85-ee0a-4ac4-9fd4-b741626f984c tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.221122 Jul 01 19:40:04.512189 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 179/348] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:04 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:04.513079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-93c08931-eae4-49dd-8fb4-b82c52ba06e7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1314 microversion: 2.1 time: 0.221383 Jul 01 19:40:04.513079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 170/349] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:04 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:04.543612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:04.544334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:04.550752 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.551369 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.552165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.552593 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.552808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:04.553473 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:04.557813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:04.560209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.560726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.561543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:04.562206 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:04.763816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:04.766320 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:04.774133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-058cb9bc-0bf9-48b5-aea8-52fd793b6fd6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.234039 Jul 01 19:40:04.775495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 180/350] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:04 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:04.780709 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:04.781973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:04.783114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-38cd94cd-f6bd-46fd-8098-22662eceafeb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.234606 Jul 01 19:40:04.783632 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 171/351] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:04 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:05.521067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:05.522450 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:05.524822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:05.525510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:05.529675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.530281 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.531174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.531702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.532409 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.532868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.533650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.534122 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.757741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:05.765402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-021c096f-f9e3-49ae-b72d-44ed99e1b908 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.248554 Jul 01 19:40:05.765992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 181/352] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:05 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:05.773088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:05.780725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-885e3580-f22c-46aa-9820-f70830566689 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1500 microversion: 2.1 time: 0.259755 Jul 01 19:40:05.781350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 172/353] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:05 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1500 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:05.791816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:05.792442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:05.799025 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.799389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.800154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.800585 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.800695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:05.801208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:05.807392 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.807771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:05.808626 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:05.809064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:06.020748 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:06.021640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:06.031898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3215da3c-c9f4-4503-a93e-faedfa8eca91 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.244006 Jul 01 19:40:06.032642 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 182/354] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:05 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:40:06.032757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:06.034170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:06.035380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-20c0bc0c-b7a0-49aa-aad6-ea63d3b9650e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.238815 Jul 01 19:40:06.036322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 173/355] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:05 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:06.785657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:06.786571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:06.793817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:06.794304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:06.795444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:06.795868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:06.939165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:06.951152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0db1f37a-85fb-41fe-a609-a34456ce9cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.171329 Jul 01 19:40:06.951968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 183/356] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:06 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:07.049620 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:07.051137 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:07.057998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:07.058464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:07.059330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:07.059659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:07.063656 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:07.063885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:07.071498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:07.072322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:07.073324 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:07.073778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:07.265001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:07.268101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:07.273312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ad1e4dbf-4421-4c9e-8019-f1c55bf8d35e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.228335 Jul 01 19:40:07.274194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 174/357] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:07 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:07.276421 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:07.277897 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:07.279022 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-38e36565-b35d-439e-bc33-9eb8c05604d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.229319 Jul 01 19:40:07.279563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 184/358] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:07 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:07.972999 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:07.973900 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:07.981449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:07.981898 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:07.982679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:07.983117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.132151 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:08.139712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b057605-6432-49d8-bd16-396c88ae4a38 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.173314 Jul 01 19:40:08.140276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 175/359] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:07 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:08.249555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84913bb0-6115-47db-b057-b4a752ea900c"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:08.250735 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:08.257370 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:08.257917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.258708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:08.259146 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.291154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:08.291879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:08.298559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:08.299011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.299762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:08.300195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.429020 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:08.436933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b91af242-fd4b-429b-9e4f-990d7fc32327 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.150148 Jul 01 19:40:08.437498 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 176/360] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:08 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:08.441854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:08.442489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:08.448346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:08.449130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.449897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:08.450359 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:08.802909 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:08.812910 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:08.814465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:08.815613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cf61ebf4-46b8-4826-80dc-bd8747b6458c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.377208 Jul 01 19:40:08.816211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 177/361] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:08 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:09.157711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:09.158828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:09.165313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.166000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.166566 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.167002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.304519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:09.312475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-efa54dfe-764a-41c7-9b36-efbc444bfc46 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.159162 Jul 01 19:40:09.313110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 178/362] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:09 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:09.317916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-37afa4ae-35dc-40b1-a68f-654b3c57dace req-493159f2-108d-4a68-bca5-86ace3d9b125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "name": "network-vif-plugged", "status": "completed", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:09.326935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-37afa4ae-35dc-40b1-a68f-654b3c57dace req-493159f2-108d-4a68-bca5-86ace3d9b125 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.327700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-37afa4ae-35dc-40b1-a68f-654b3c57dace req-493159f2-108d-4a68-bca5-86ace3d9b125 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.341208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-37afa4ae-35dc-40b1-a68f-654b3c57dace req-493159f2-108d-4a68-bca5-86ace3d9b125 service nova] Creating event network-vif-plugged:7ff227c5-7dfc-4476-b094-d71e27fb265f for instance fc929a10-068e-444f-bc59-ab78f9821237 on hv-cinder-83124 Jul 01 19:40:09.346488 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-37afa4ae-35dc-40b1-a68f-654b3c57dace req-493159f2-108d-4a68-bca5-86ace3d9b125 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Jul 01 19:40:09.347086 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 179/363] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:09.455337 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:09.456032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:09.462958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.463416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.464155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.464622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.600634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:09.608998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a25f5862-0142-4958-a859-90a9dc3267b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.157979 Jul 01 19:40:09.609563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 180/364] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:09 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:09.837642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:09.838201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:09.844355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.844883 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.845657 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:09.846115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:09.980035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:09.988306 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:09.989802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:09.990946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-026a7f48-8d6f-4ecd-8842-c5cb9d6ee5b0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.159263 Jul 01 19:40:09.991531 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 181/365] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:09 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:10.331565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:10.332438 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:10.341301 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:10.342005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:10.343205 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:10.343836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:10.483422 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:10.492378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a85ad9e6-0494-48b6-8697-db26cc2d3213 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.165523 Jul 01 19:40:10.493183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 182/366] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:10 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:10.626211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:10.626812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:10.633001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:10.633457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:10.634260 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:10.634693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:10.817778 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:10.826938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bbf65905-554b-41d6-8c25-cbc8c191bc45 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.204537 Jul 01 19:40:10.827778 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 183/367] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:10 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:10.846922 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d36bc695-672c-46ce-bd23-f2b6a4a16c6f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "POST /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.601191 Jul 01 19:40:10.847777 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 185/368] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:40:08 2022] POST /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d/os-volume_attachments => generated 194 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:11.009148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:11.009756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:11.016272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:11.016724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:11.017485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:11.017924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:11.150665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:11.153001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:11.160356 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:11.161843 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:11.163009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a2a352e-187f-4cf2-8832-30a1bf3557d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.157948 Jul 01 19:40:11.163557 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 184/369] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:11 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:11.509823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:11.510548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:11.517535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:11.518116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:11.518887 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:11.519323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:11.794684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:11.802185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e5e285b1-2f60-441d-a81b-5032df9e84ae tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.297088 Jul 01 19:40:11.802753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 186/370] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:11 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:11.844635 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:11.845227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:11.851824 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:11.852320 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:11.853081 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:11.853517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:12.005351 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:12.013487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-562bfb09-331f-4023-98f6-240230a3eac1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.172771 Jul 01 19:40:12.014076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 185/371] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:11 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:12.183394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:12.183963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:12.191330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:12.191771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:12.192541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:12.192960 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:12.322055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:12.330373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:12.331860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:12.332935 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fe4dbec4-e139-4c57-b52c-32e544c5bcbc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.154321 Jul 01 19:40:12.333535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 187/372] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:12 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:12.819435 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:12.820051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:12.827365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:12.827821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:12.828582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:12.829015 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:12.970097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:12.978455 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bde44f93-c8f7-4c3c-8c61-1e7a94cff7cb tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.162802 Jul 01 19:40:12.979136 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 186/373] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:12 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:13.031137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:13.032018 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:13.038323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:13.038765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:13.039532 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:13.039957 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:13.178550 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:13.186351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1f016665-fc2a-4f24-9cff-a36761a0d4e6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.159571 Jul 01 19:40:13.186945 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 188/374] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:13 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:13.350495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:13.351101 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:13.357651 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:13.358136 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:13.358874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:13.359303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:13.495010 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:13.506052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:13.507550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:13.508673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f66fb294-034a-4f4d-a8e9-36bf064a5785 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1404 microversion: 2.20 time: 0.162234 Jul 01 19:40:13.509240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 187/375] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:13 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:14.003093 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:14.003842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:14.006384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:14.012183 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.012631 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.013412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.013846 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.164373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:14.172277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fbb4d182-5d1f-481c-8d81-be8f10ff4841 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.175047 Jul 01 19:40:14.172849 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 189/376] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:13 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:14.203612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:14.204288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:14.210934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.211451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.212286 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.212758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.353028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:14.364598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a897d06b-c082-4f19-ab32-8436326a172a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.164804 Jul 01 19:40:14.365193 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 188/377] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:14 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:14.527192 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:14.527821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:14.534555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.534997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.535768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.536206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.668637 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:14.677607 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:14.679150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:14.680318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-534963c8-6288-4dee-8b84-2672c36afeab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1595 microversion: 2.20 time: 0.157138 Jul 01 19:40:14.680885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 190/378] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:40:14 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:40:14.699105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:14.699644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:14.705926 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.706410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.707170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:14.707610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:14.795155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3b0c7225-1a96-458a-9649-4b219fbee0fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100330 Jul 01 19:40:14.795996 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 189/379] 10.222.0.61 () {60 vars in 1315 bytes} [Fri Jul 1 19:40:14 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:40:15.189570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:15.190458 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:15.197340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:15.197785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:15.198583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:15.199509 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:15.380960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:15.381511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:15.388503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:15.389094 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:15.389981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:15.391437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:15.441928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:15.450300 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b2415cb1-6e7d-4267-b802-e8ea708c6be1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.264635 Jul 01 19:40:15.450861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 191/380] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:15 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:15.616637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:15.624832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ed69f5e7-f391-4792-9266-5927ccb8fc08 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.247897 Jul 01 19:40:15.625453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 190/381] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:15 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:15.902130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-d0f575c7-a222-4092-a873-ea355c113884 req-e9ecea4c-b3f6-422f-a834-63f72ee06582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:15.917991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d0f575c7-a222-4092-a873-ea355c113884 req-e9ecea4c-b3f6-422f-a834-63f72ee06582 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:15.918653 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d0f575c7-a222-4092-a873-ea355c113884 req-e9ecea4c-b3f6-422f-a834-63f72ee06582 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:15.932013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-d0f575c7-a222-4092-a873-ea355c113884 req-e9ecea4c-b3f6-422f-a834-63f72ee06582 service nova] Creating event network-changed:7ff227c5-7dfc-4476-b094-d71e27fb265f for instance fc929a10-068e-444f-bc59-ab78f9821237 on hv-cinder-83124 Jul 01 19:40:15.940393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-d0f575c7-a222-4092-a873-ea355c113884 req-e9ecea4c-b3f6-422f-a834-63f72ee06582 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040878 Jul 01 19:40:15.941919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 192/382] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:15.952487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-913304a5-2055-49e2-871c-4b4f7c995a48 req-2fcb5ac3-a525-4d03-b75c-ae487a64392e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54552177-8284-492d-b816-ff15c8d350bb", "name": "network-vif-plugged", "status": "completed", "tag": "696cb842-33cd-4a72-9d6c-9d14350288fe"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:15.964896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-913304a5-2055-49e2-871c-4b4f7c995a48 req-2fcb5ac3-a525-4d03-b75c-ae487a64392e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:15.965614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-913304a5-2055-49e2-871c-4b4f7c995a48 req-2fcb5ac3-a525-4d03-b75c-ae487a64392e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:15.989387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-913304a5-2055-49e2-871c-4b4f7c995a48 req-2fcb5ac3-a525-4d03-b75c-ae487a64392e service nova] Creating event network-vif-plugged:696cb842-33cd-4a72-9d6c-9d14350288fe for instance 54552177-8284-492d-b816-ff15c8d350bb on hv-cinder-83124 Jul 01 19:40:15.995169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-913304a5-2055-49e2-871c-4b4f7c995a48 req-2fcb5ac3-a525-4d03-b75c-ae487a64392e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049449 Jul 01 19:40:15.995875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 191/383] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:16.467835 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:16.468565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:16.475521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:16.475978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:16.476755 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:16.477187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:16.611336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:16.619112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a4e69860-b352-434d-8caa-c52c24786d09 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.155580 Jul 01 19:40:16.619686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 193/384] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:16 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:40:16.644353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:16.645673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:16.652498 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:16.652963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:16.653736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:16.654194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:16.791115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:16.799472 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5e9080f-3dd1-4e18-bd68-2f18c1e26397 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.159372 Jul 01 19:40:16.800050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 192/385] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:16 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:17.636035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:17.636686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:17.643821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:17.644272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:17.645032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:17.645464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:17.783021 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:17.790628 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fdd1d38f-81f1-4fc4-82d4-e47a2f14ffef tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.158585 Jul 01 19:40:17.791168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 194/386] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:17 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:17.816895 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:17.817503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:17.824291 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:17.824740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:17.825637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:17.826102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:17.974585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:17.985693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9ee4ab5f-14a6-46e6-8d07-22dbd80e1859 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.172189 Jul 01 19:40:17.986392 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 193/387] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:17 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:18.811199 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:18.811782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:18.818935 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:18.819386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:18.820228 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:18.820598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:18.960503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:18.968379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5736b05b-a242-4e65-9ba1-d7ebe8cbd2a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1314 microversion: 2.1 time: 0.163492 Jul 01 19:40:18.968951 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 195/388] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:18 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:19.007318 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:19.007908 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:19.014797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:19.015245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:19.015999 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:19.016432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:19.156025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:19.164494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f3c54e52-6c58-43c7-a4f4-42f8bc5de13b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.160962 Jul 01 19:40:19.165063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 194/389] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:19 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:19.987714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:19.988534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:19.997688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:19.998314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:19.999317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:19.999878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:20.004271 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:20.133732 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:20.143436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e7f0f27a-babf-4167-a083-f85a71ffa93a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1497 microversion: 2.1 time: 0.160753 Jul 01 19:40:20.144659 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 196/390] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:19 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:20.183906 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:20.184494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:20.191096 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:20.191533 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:20.192286 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:20.192712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:20.332058 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:20.340707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85f66cd5-40d3-448e-b1b7-a9b628f7bc23 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.160567 Jul 01 19:40:20.341362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 195/391] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:20 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:20.916706 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:20.917194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:20.923417 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:20.923967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:20.924708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:20.925131 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:20.955541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:40:21.060164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cafd0641-9124-441d-9ef5-7dd49fd51e5f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "DELETE /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 204 len: 0 microversion: 2.1 time: 0.146707 Jul 01 19:40:21.061395 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 197/392] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:40:20 2022] DELETE /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:40:21.072878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:21.074047 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:21.082252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:21.082934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:21.083701 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:21.084138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:21.223026 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:21.230739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-db975fff-1df5-4c20-b70d-920e4b31890a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1503 microversion: 2.1 time: 0.164616 Jul 01 19:40:21.231330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 196/393] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:21 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:21.361544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:21.362438 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:21.370573 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:21.371146 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:21.372127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:21.372776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:21.506769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:21.514487 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f533f32d-ce5c-4a57-9fcd-2d379fab9276 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.159859 Jul 01 19:40:21.515067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 198/394] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:21 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:22.250268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:22.250878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:22.257855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:22.258340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:22.259109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:22.259533 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:22.400573 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:22.408727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-098d0f02-5c71-4048-af39-e477d5abd50a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1503 microversion: 2.1 time: 0.162386 Jul 01 19:40:22.409294 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 197/395] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:22 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:22.532590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:22.533287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:22.540280 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:22.540724 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:22.541482 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:22.541905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:22.675574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:22.683094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9878323f-de40-44c2-8be7-be925e860229 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.155077 Jul 01 19:40:22.683646 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 199/396] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:22 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:23.426958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:23.427514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:23.434148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:23.434587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:23.435332 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:23.435754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:23.571160 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:23.579375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-38934495-a730-40d5-a81f-5ddda58557d3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1503 microversion: 2.1 time: 0.157213 Jul 01 19:40:23.579973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 198/397] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:23 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:23.701349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:23.701993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:23.711346 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:23.711797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:23.712565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:23.712999 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:23.845977 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:23.854252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1f4c044d-fe89-47c8-a727-3f893287dd74 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.157973 Jul 01 19:40:23.854815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 200/398] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:23 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:24.596588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:24.597247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:24.603829 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:24.604217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:24.604976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:24.605422 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:24.744542 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:24.755873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bca330d5-e6e7-47b4-9b8d-5eec586c5cbf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1503 microversion: 2.1 time: 0.162897 Jul 01 19:40:24.756677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 199/399] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:24 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:24.873881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:24.874478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:24.881444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:24.881878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:24.882699 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:24.883223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:25.022290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:25.033210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-41399a21-801b-49ad-b8e4-1d83b80bf79e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.163260 Jul 01 19:40:25.033853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 201/400] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:24 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:25.776881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:25.777465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:25.779516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=90 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:25.785543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:25.785979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:25.786767 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:25.787194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:25.923037 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:25.934011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f5e758d-2b73-4785-b101-e7b656b2307e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1503 microversion: 2.1 time: 0.160730 Jul 01 19:40:25.935100 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 200/401] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:25 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:26.054290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:26.054875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:26.062611 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:26.064087 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:26.064901 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:26.065352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:26.200793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:26.210424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1d1fd7eb-3336-4f9f-8d21-f8cc27e09d71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.162004 Jul 01 19:40:26.211006 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 202/402] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:26 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:26.894234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:26.894902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:26.901357 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:26.901905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:26.902811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:26.903341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:26.931895 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:40:26.957436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:26.958307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:26.966993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:26.967517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:26.967856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:26.969509 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:26.970135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:27.042889 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f2cc1c5-c22e-4403-b646-bdebb6690b87 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 204 len: 0 microversion: 2.1 time: 0.152144 Jul 01 19:40:27.043653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 201/403] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:40:26 2022] DELETE /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:40:27.052828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:27.053554 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:27.064767 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:27.065224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:27.066082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:27.066511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:27.400365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:27.407937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-96122dd4-34e7-4e13-b331-bab85826fd5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1503 microversion: 2.1 time: 0.456234 Jul 01 19:40:27.408505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 203/404] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:26 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:27.412967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:27.413588 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:27.420291 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:27.420806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:27.421771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:27.422231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:27.455895 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:27.464249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-70ec8195-aec4-4818-9d78-7e2c91aaeb6d tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.415618 Jul 01 19:40:27.464823 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 202/405] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:27 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:27.478368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9c1265d0-9c9c-496a-b0e0-46557df90332 req-9883c765-9ce3-4992-89cd-3f0ac802b11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54552177-8284-492d-b816-ff15c8d350bb", "name": "network-vif-deleted", "tag": "696cb842-33cd-4a72-9d6c-9d14350288fe"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:27.486272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9c1265d0-9c9c-496a-b0e0-46557df90332 req-9883c765-9ce3-4992-89cd-3f0ac802b11f service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:27.486698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9c1265d0-9c9c-496a-b0e0-46557df90332 req-9883c765-9ce3-4992-89cd-3f0ac802b11f service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:27.498057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9c1265d0-9c9c-496a-b0e0-46557df90332 req-9883c765-9ce3-4992-89cd-3f0ac802b11f service nova] Creating event network-vif-deleted:696cb842-33cd-4a72-9d6c-9d14350288fe for instance 54552177-8284-492d-b816-ff15c8d350bb on hv-cinder-83124 Jul 01 19:40:27.503305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9c1265d0-9c9c-496a-b0e0-46557df90332 req-9883c765-9ce3-4992-89cd-3f0ac802b11f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028581 Jul 01 19:40:27.504044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 203/406] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:27.553507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:27.561985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4b2863b9-7b96-4677-a639-94e48dc52c7d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.152501 Jul 01 19:40:27.562757 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 204/407] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:27 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:28.430942 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:28.431642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:28.438293 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:28.438720 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:28.439475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:28.439904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:28.481358 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:28.481998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:28.488652 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:28.489097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:28.489859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:28.490318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:28.505626 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:28.513255 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-61f1df45-df8d-4e52-8857-fb5c3c536bfc tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1461 microversion: 2.1 time: 0.089777 Jul 01 19:40:28.513809 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 204/408] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:28 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:28.579365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:28.580158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:28.586672 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:28.587208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:28.588061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:28.588493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:28.636667 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:28.644991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fa0dfa71-ed24-4eb1-b0e6-921f7040734f tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.167495 Jul 01 19:40:28.645562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 205/409] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:28 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:40:28.779419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:28.788386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e623b353-2840-4971-99cc-39f199d35ea4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.212616 Jul 01 19:40:28.788985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 205/410] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:28 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:29.534312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:29.535329 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:29.544436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.544888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.545662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.546121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.577452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.577819 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.578310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lazy-loading 'fault' on Instance uuid 54552177-8284-492d-b816-ff15c8d350bb {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:40:29.626673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:29.634557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b10b1e57-7899-401b-87bc-faf7bccba503 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1304 microversion: 2.1 time: 0.106813 Jul 01 19:40:29.635121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 206/411] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:29 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:29.662271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:29.663105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:29.669334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.669777 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.670563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.670994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.804850 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:29.805467 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:29.806870 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:29.811857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.812340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.813105 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:29.813535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:29.814928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57657aca-8e30-43f4-baac-f40ecbf7efef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.156469 Jul 01 19:40:29.815530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 206/412] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:29 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:29.946758 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:29.958671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cbca329f-b0a6-4fb6-a46d-e99868ce8dae tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.157446 Jul 01 19:40:29.959499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 207/413] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:29 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:30.652493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:30.653104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:30.659247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.659687 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.660428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.660879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.695064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.695625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.695943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lazy-loading 'fault' on Instance uuid 54552177-8284-492d-b816-ff15c8d350bb {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:40:30.738877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:30.746735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a408006-3aa8-427e-999e-99d3ffaec38d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1304 microversion: 2.1 time: 0.098485 Jul 01 19:40:30.747627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 207/414] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:30 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:30.831886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:30.832459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:30.839316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.839760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.840514 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.840944 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.977838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:30.978604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:30.981829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:30.987501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.988104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.988892 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:30.989331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:30.997292 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d46bce7d-0594-4b9b-9f2b-a6729d1ff050 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.169249 Jul 01 19:40:31.003036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 208/415] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:30 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:31.132016 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:31.140258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b75b6796-3fe7-4e9a-9cdc-7376574fbfcd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.167444 Jul 01 19:40:31.140831 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 208/416] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:30 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:31.768625 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:31.769231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:31.775984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:31.776435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:31.777195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:31.777628 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:31.811705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:31.812151 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:31.812573 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lazy-loading 'fault' on Instance uuid 54552177-8284-492d-b816-ff15c8d350bb {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:40:31.855050 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:31.863062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a2bd7dc5-b884-40f3-a3c8-431628b546c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 200 len: 1304 microversion: 2.1 time: 0.098241 Jul 01 19:40:31.864365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 209/417] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:31 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:32.018171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:32.018998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:32.027208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:32.027649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:32.028405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:32.028857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:32.157404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:32.158272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:32.164546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:32.164992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:32.165748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:32.166185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:32.168080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:32.176102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc57bfec-c09f-49a4-a68c-ffbc0c31391e tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.164495 Jul 01 19:40:32.176669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 209/418] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:32 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:32.187410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:32.311280 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:32.319098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d71d6a80-7503-4b26-b143-df11a810d2fd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.165828 Jul 01 19:40:32.319652 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 210/419] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:32 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:40:32.882139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:32.882965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: 54552177-8284-492d-b816-ff15c8d350bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:32.889449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:32.889856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:32.890696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:32.891134 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:32.906155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] HTTP exception thrown: Instance 54552177-8284-492d-b816-ff15c8d350bb could not be found. Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Request method failure captured: Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb HTTP/1.1 Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv01pqJ1rFrbsvt5sFaBijRs8UahhEmMTxAm6WGwKfLT3RYmhSG_NDPynn_e_JfcZ1WuInATJM2lFrLe8mYFlDS7JXiJqqgxtqC0gs-EkFnq-i9FIGbKbYj3DvNs4Su45_U9IlO9bx3bZon26CNjZiiYu76rfdys4NvuPrtRcGpmRScE Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: fd410d5a356243c6b7b71cfb958fcdfc Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesActionsTest-398598798 Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:40:32.911951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd410d5a356243c6b7b71cfb958fcdfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd410d5a356243c6b7b71cfb958fcdfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd410d5a356243c6b7b71cfb958fcdfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd410d5a356243c6b7b71cfb958fcdfc", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesActionsTest-398598798 Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: fd410d5a356243c6b7b71cfb958fcdfc Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesActionsTest-398598798 Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesActionsTest-398598798-project Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: c8d8523e71264696997f23122115687a Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesActionsTest-398598798-project Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 54552177-8284-492d-b816-ff15c8d350bb could not be found. Jul 01 19:40:32.913303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '54552177-8284-492d-b816-ff15c8d350bb'} Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54552177-8284-492d-b816-ff15c8d350bb could not be found. Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:40:32.914023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54552177-8284-492d-b816-ff15c8d350bb could not be found. Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54552177-8284-492d-b816-ff15c8d350bb could not be found. Jul 01 19:40:32.915855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:32.917071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Returning 404 to user: Instance 54552177-8284-492d-b816-ff15c8d350bb could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:40:32.917071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f45e9ca6-bf93-4172-a165-7960e5615ffa tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb" status: 404 len: 111 microversion: 2.1 time: 0.035665 Jul 01 19:40:32.917071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 210/420] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:32 2022] GET /compute/v2.1/servers/54552177-8284-492d-b816-ff15c8d350bb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:33.053057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-450255122", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "networks": [{"uuid": "83e98fcd-5ce9-45da-a8d6-fefc9a27caf0"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:33.114413 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] validate_networks() for [('83e98fcd-5ce9-45da-a8d6-fefc9a27caf0', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:40:33.193093 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:33.193623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:33.200791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:33.201231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:33.201976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:33.202439 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:33.421652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:33.429977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ee45eb45-3d51-4efa-9de1-ec48df9c9e66 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.241071 Jul 01 19:40:33.430814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 211/421] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:33 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:33.434974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:33.435563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:33.441980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:33.442536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:33.443365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:33.443728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:33.570247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:40:33.570675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:40:33.571172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:40:33.571612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:40:33.572724 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:40:33.583226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:33.583680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:33.584469 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:33.584898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:33.602343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Getting quotas for project fd410d5a356243c6b7b71cfb958fcdfc. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:40:33.606603 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Getting quotas for user c8d8523e71264696997f23122115687a and project fd410d5a356243c6b7b71cfb958fcdfc. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:40:33.614629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:33.618805 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:40:33.621339 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:40:33.622631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-31f0c815-e772-4116-8464-a77f151b94b7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.191096 Jul 01 19:40:33.623218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 212/422] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:33 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:33.666754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-77705135-c9f0-4ac5-b2df-ed69cd5d911e tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617521 Jul 01 19:40:33.667371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 211/423] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:40:33.679035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25b61591-b286-449d-a53f-d3abbaf53cff tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:33.679644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-25b61591-b286-449d-a53f-d3abbaf53cff tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:33.731947 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-25b61591-b286-449d-a53f-d3abbaf53cff tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:33.738672 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-25b61591-b286-449d-a53f-d3abbaf53cff tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1213 microversion: 2.1 time: 0.064857 Jul 01 19:40:33.739231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 213/424] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:33 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:34.447521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:34.448129 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:34.455702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:34.456152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:34.456918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:34.457346 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:34.585878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:34.594371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c6acd7a-2b86-4e97-b1b8-606268584d99 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.151206 Jul 01 19:40:34.594947 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 212/425] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:34 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:34.643237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:34.644130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:34.654770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:34.655531 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:34.656790 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:34.657514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:34.756480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:34.757098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:34.763245 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:34.763691 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:34.764442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:34.764905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:34.797385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:34.805109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9d10daea-58b5-4fa0-bacf-ced18f505023 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.168526 Jul 01 19:40:34.805709 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 214/426] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:34 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:34.826208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:34.833697 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-358a30d8-92d5-40af-adb3-76d9bfc2a9d8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.081147 Jul 01 19:40:34.834308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 213/427] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:34 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:35.615654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:35.616596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:35.626992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:35.627736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:35.629035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:35.629800 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:35.766067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:35.774203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90ef8ce2-5ba3-4b8e-9e9a-7f5153200ee8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.164985 Jul 01 19:40:35.774878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 215/428] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:35 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:35.822270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:35.822880 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:35.829906 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:35.830386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:35.831142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:35.831573 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:35.850788 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:35.851393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:35.857633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:35.858116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:35.858877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:35.859303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:35.925570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:35.933326 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eefb3835-0ac8-49e1-8eaa-cbf9aeb78877 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.086346 Jul 01 19:40:35.934313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 216/429] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:35 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:35.989549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:35.997198 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eb141ce8-7936-4367-bf16-b358bcddf8d5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.178867 Jul 01 19:40:35.997765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 214/430] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:35 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:36.796194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:36.797472 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:36.807482 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:36.807925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:36.808679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:36.809101 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:36.950034 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:36.951055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:36.951818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:36.958284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d32bb62c-942f-4bff-8c13-fb459a55d80c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.168815 Jul 01 19:40:36.958421 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:36.958778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:36.958887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 217/431] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:36 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:36.959655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:36.960247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:37.013977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:37.014586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:37.021256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:37.021902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:37.022634 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:37.022784 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:37.023264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:37.030068 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-42ad2af2-479d-44f5-9366-2bcd5a188c88 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.083302 Jul 01 19:40:37.030620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 215/432] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:36 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:37.158529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:37.167441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2c4a6a74-0ff9-4725-859f-ab8f105c9d52 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.157282 Jul 01 19:40:37.168014 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 218/433] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:37 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:40:37.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:37.980552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:37.992541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:37.993285 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:37.994322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:37.994735 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:38.054582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:38.056606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:38.066558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:38.067325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:38.068136 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:38.068567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:38.085607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:38.141140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:38.148687 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-babb5f45-432e-450a-8135-f5bc55083d5a tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.098265 Jul 01 19:40:38.149250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 219/434] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:38 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:38.152754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:38.161085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9c5a0d50-e6f9-4f47-b412-0810704719e3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.188088 Jul 01 19:40:38.161679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 216/435] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:37 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:38.187654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:38.188270 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:38.194673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:38.195124 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:38.195888 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:38.196321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:38.312209 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-fc4a61d8-48d9-43f6-9b8f-be286d1c8311 req-884d9ac5-5b50-4b6b-98a8-8eb0bd9f0d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b536cd-c30e-4d09-ac25-11cc3cff1d0d", "name": "network-vif-unplugged", "status": "completed", "tag": "8019d8bc-d12d-47ba-91e0-87195457857a"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:38.321797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-fc4a61d8-48d9-43f6-9b8f-be286d1c8311 req-884d9ac5-5b50-4b6b-98a8-8eb0bd9f0d70 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:38.322631 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-fc4a61d8-48d9-43f6-9b8f-be286d1c8311 req-884d9ac5-5b50-4b6b-98a8-8eb0bd9f0d70 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:38.328213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:38.336091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f3203b7c-4753-4061-a1c5-345e254d7fe4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.152162 Jul 01 19:40:38.336937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 220/436] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:38 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:38.337351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-fc4a61d8-48d9-43f6-9b8f-be286d1c8311 req-884d9ac5-5b50-4b6b-98a8-8eb0bd9f0d70 service nova] Creating event network-vif-unplugged:8019d8bc-d12d-47ba-91e0-87195457857a for instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d on hv-cinder-83124 Jul 01 19:40:38.342760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-fc4a61d8-48d9-43f6-9b8f-be286d1c8311 req-884d9ac5-5b50-4b6b-98a8-8eb0bd9f0d70 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034696 Jul 01 19:40:38.343438 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 217/437] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:40:39.165139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:39.165808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:39.172354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:39.172772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:39.173559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:39.173981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:39.179122 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:39.179820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:39.186575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:39.187054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:39.187824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:39.188257 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:39.247622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:39.255486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-35a6f4be-d627-4801-b8b1-93a93ba7fcf0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.094150 Jul 01 19:40:39.256079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 221/438] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:39 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:39.332863 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:39.341007 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-53231f39-7ffd-47b1-ba9d-e243a4a54006 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.166608 Jul 01 19:40:39.341576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 218/439] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:39 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:39.352546 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:39.353209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:39.359438 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:39.359894 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:39.360650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:39.361088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:39.490331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:39.498698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ee8c39a8-8351-4d35-abf6-8c1a7c18d5f4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.149897 Jul 01 19:40:39.499497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 222/440] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:39 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:40.276237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:40.276888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:40.284583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:40.285085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:40.285936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:40.286459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:40.357762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:40.358771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:40.359383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:40.365772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:40.365941 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ffdac262-80b8-4f90-8ee4-d1cdc1ae53f3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.095733 Jul 01 19:40:40.366252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:40.373999 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 219/441] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:40 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:40.374181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:40.374181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:40.506576 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:40.514706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d03d9cde-86f1-450b-8e56-ef60cfd2e408 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.159706 Jul 01 19:40:40.515309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 223/442] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:40 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:40.515755 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:40.516364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:40.522577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:40.523023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:40.523779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:40.524206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:40.656268 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:40.664315 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-02682035-0fee-458b-9501-549910981da4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.152604 Jul 01 19:40:40.664896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 220/443] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:40 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:41.386303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:41.386877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:41.393563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:41.393994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:41.394752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:41.395229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:41.458454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:41.466303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b4e9b76a-b184-40fb-8569-899b1ff46e28 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1217 microversion: 2.1 time: 0.085775 Jul 01 19:40:41.466883 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 224/444] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:41 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:41.535349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:41.536212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:41.544596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:41.545047 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:41.545810 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:41.546282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:41.675489 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:41.680641 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:41.681370 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:41.683812 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-41f67d0a-68c7-4445-8780-346f65030aa6 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1552 microversion: 2.1 time: 0.154625 Jul 01 19:40:41.684380 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 221/445] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:41 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:41.687862 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:41.688315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:41.689108 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:41.689540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:41.820751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:41.828795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4f58a474-18a3-4b0a-b219-67b1022e7f19 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1519 microversion: 2.1 time: 0.152002 Jul 01 19:40:41.829361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 225/446] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:41 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:42.482737 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:42.483324 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:42.489876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.490356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.491263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.491540 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.603429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:42.611427 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-acea9d20-c912-4e35-8b45-a10b569f8bc1 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1265 microversion: 2.1 time: 0.132634 Jul 01 19:40:42.611991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 222/447] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:42 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:42.701076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:42.701689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:42.708229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.708653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.709424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.709900 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.810419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:42.820355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-53d51086-d42b-4db7-8bd2-e4d31f817a36 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1510 microversion: 2.1 time: 0.123497 Jul 01 19:40:42.820947 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 226/448] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:42 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1510 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:42.843786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-14984dc3-9431-4622-9b46-aadd6ad03dec req-4e49fb44-11b8-474f-8e5c-164a29c9d374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b536cd-c30e-4d09-ac25-11cc3cff1d0d", "name": "network-vif-deleted", "tag": "8019d8bc-d12d-47ba-91e0-87195457857a"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:42.845699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:42.846391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:42.852024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-14984dc3-9431-4622-9b46-aadd6ad03dec req-4e49fb44-11b8-474f-8e5c-164a29c9d374 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.852471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-14984dc3-9431-4622-9b46-aadd6ad03dec req-4e49fb44-11b8-474f-8e5c-164a29c9d374 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.853204 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.853650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.854500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:42.854932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:42.871551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-14984dc3-9431-4622-9b46-aadd6ad03dec req-4e49fb44-11b8-474f-8e5c-164a29c9d374 service nova] Creating event network-vif-deleted:8019d8bc-d12d-47ba-91e0-87195457857a for instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d on hv-cinder-83124 Jul 01 19:40:42.877935 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-14984dc3-9431-4622-9b46-aadd6ad03dec req-4e49fb44-11b8-474f-8e5c-164a29c9d374 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039065 Jul 01 19:40:42.878983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 223/449] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:43.004574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:43.013018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a20a5ed6-3a2d-43e9-9314-a81cb5758601 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1499 microversion: 2.1 time: 0.171569 Jul 01 19:40:43.013606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 227/450] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:42 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:43.029632 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:43.030352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:43.036640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:43.037081 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:43.037837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:43.038298 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:43.175994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:43.184046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7f3951c6-55a9-492b-9183-61cec5efba07 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1516 microversion: 2.1 time: 0.158611 Jul 01 19:40:43.184614 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 224/451] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:43 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:43.631100 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:43.632185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:43.639376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:43.640078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:43.640841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:43.641473 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:43.716642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:43.724468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-300274f9-511b-4a90-917c-ddf1049c0138 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1283 microversion: 2.1 time: 0.097522 Jul 01 19:40:43.725055 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 228/452] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:43 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1283 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:43.837707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:43.838412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:43.842024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:43.842870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:43.848429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:43.848879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:43.849654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:43.850122 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:43.938596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:43.946700 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ff7ec34a-a312-4f30-a646-6ec67d6c1088 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.113145 Jul 01 19:40:43.947271 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 225/453] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:43 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:44.741849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:44.742461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:44.744649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:44.750087 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:44.750535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:44.751303 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:44.751732 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:44.962638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:44.969288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:44.969288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:44.969798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:44.973244 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:44.973758 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:44.974942 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:44.975548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:44.980104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a9f5a375-5624-4eeb-be78-155fefb60a66 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.242660 Jul 01 19:40:44.980695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 229/454] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:44 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:45.058699 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:45.070083 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7675c893-aae3-4141-855a-0812295d783c tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.109383 Jul 01 19:40:45.070779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 226/455] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:44 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:45.182053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ebec0380-07de-42bc-a715-2c40a633a76a req-5df95567-301e-4e5a-a93f-821f922caf32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bf2316-2508-413e-9761-2795b257c84c", "tag": "27f96ab5-aa7a-44be-a6e8-95a88f08f450"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:45.191280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ebec0380-07de-42bc-a715-2c40a633a76a req-5df95567-301e-4e5a-a93f-821f922caf32 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:45.191728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ebec0380-07de-42bc-a715-2c40a633a76a req-5df95567-301e-4e5a-a93f-821f922caf32 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:45.203853 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ebec0380-07de-42bc-a715-2c40a633a76a req-5df95567-301e-4e5a-a93f-821f922caf32 service nova] Creating event network-changed:27f96ab5-aa7a-44be-a6e8-95a88f08f450 for instance f3bf2316-2508-413e-9761-2795b257c84c on hv-cinder-83124 Jul 01 19:40:45.208723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ebec0380-07de-42bc-a715-2c40a633a76a req-5df95567-301e-4e5a-a93f-821f922caf32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032373 Jul 01 19:40:45.209334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 230/456] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:45.996679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:45.998058 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:46.005192 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:46.005829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:46.006760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:46.007340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:46.088244 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:46.088882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:46.095504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:46.095949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:46.096720 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:46.097155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:46.172025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:46.180761 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62c31c20-8c31-4ee7-ac11-8d87bd5aa301 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.096889 Jul 01 19:40:46.181333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 231/457] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:46 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:46.193911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:46.202661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3b672426-dc87-464b-b66c-af0847f8a2e5 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.209748 Jul 01 19:40:46.203231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 227/458] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:45 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:47.202066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:47.202703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:47.209203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:47.209657 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:47.210454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:47.210890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:47.219549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:47.220152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:47.227226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:47.227674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:47.228434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:47.228871 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:47.282527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:47.290783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ea899e7e-af3c-4941-a643-7237d9d94cf8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.095367 Jul 01 19:40:47.291351 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 232/459] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:47 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:47.368736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:47.380841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a0224654-a1ff-4b57-9b82-606ab6125961 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.164799 Jul 01 19:40:47.381609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 228/460] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:47 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:48.312116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:48.312910 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:48.323300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:48.324409 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:48.325667 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:48.326541 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:48.401594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:48.402220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:48.402376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:48.408825 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:48.409266 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:48.410048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:48.410480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:48.411003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d370b984-8ec5-4377-a49c-85108519b1a8 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.105535 Jul 01 19:40:48.411629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 233/461] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:48 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:48.414615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:48.545074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:48.552746 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dd7c2fa1-8970-4d56-89d8-ae910d72aae6 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.155168 Jul 01 19:40:48.553293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 229/462] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:48 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:40:49.428458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:49.429204 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:49.435668 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.436120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.436895 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.437330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.501994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:49.510208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-badcf8d4-fa7d-456c-be2c-86c0bab1e4ef tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.085789 Jul 01 19:40:49.510768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 234/463] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:49 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:49.570041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:49.570640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:49.578258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.578683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.579457 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.579886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.742128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:49.749985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-baeb10e0-05db-4f26-8361-97a8754d5ec0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.183917 Jul 01 19:40:49.750608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 230/464] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:49 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:49.849034 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:49.850069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:49.856681 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.857135 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.857885 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.858353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.882080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lazy-loading 'flavor' on Instance uuid 061b75be-e4ba-4cb7-b74a-3373e5495283 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:40:49.916024 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:49.969434 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e29b6d56-03f1-4955-9733-ab4151d0546b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/action" status: 200 len: 32 microversion: 2.1 time: 0.124292 Jul 01 19:40:49.969976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 235/465] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:40:49 2022] POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:40:49.979185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:49.979792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:49.986709 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.987160 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:49.987924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:49.988360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:50.119856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:50.127654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-806b2a00-07b5-44d4-9a03-647a9fde14f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.152345 Jul 01 19:40:50.128220 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 231/466] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:49 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:50.529116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:50.529900 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:50.542366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:50.542833 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:50.543639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:50.544052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:50.607343 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:50.616289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e64c193b-76a3-42ed-8f2e-29ece57bb2f3 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.092417 Jul 01 19:40:50.616869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 236/467] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:50 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:50.771758 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:50.772559 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:50.782143 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:50.782584 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:50.783317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:50.783768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:50.921727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:50.929337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dd641618-3dfb-4cf3-ba22-a08cf91fa302 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.165072 Jul 01 19:40:50.929898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 232/468] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:50 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:51.148539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:51.149539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:51.160096 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:51.160844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:51.162139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:51.162844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:51.312686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:51.324722 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-28b445cf-8085-476a-9871-d29808d21336 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.182389 Jul 01 19:40:51.325276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 237/469] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:51 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:51.636491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:51.637326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:51.646788 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:51.647367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:51.648533 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:51.649188 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:51.713171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c1e464c194939ac4ead76af5440fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ecca1332d04a0faf9ccbb60f958e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:51.725418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4c24e8ab-43c8-42f9-a76e-86f947232db7 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 200 len: 1345 microversion: 2.1 time: 0.094831 Jul 01 19:40:51.726309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 233/470] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:51 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:51.947168 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:51.947776 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:51.955975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:51.956677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:51.957570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:51.958027 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.095872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:52.107356 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8f66a3ed-a90b-4480-aa25-4bb9c880dcc0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.163985 Jul 01 19:40:52.108073 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 238/471] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:51 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:52.348037 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:52.349779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:52.358250 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:52.359365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.360410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:52.361011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.590724 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:52.598626 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c1ef23e6-e517-4db5-9214-fbf4282ba071 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.255240 Jul 01 19:40:52.599196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 234/472] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:52 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:52.745126 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:52.745810 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:52.752169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:52.752614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.753375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:52.753795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.770157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] HTTP exception thrown: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Request method failure captured: Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d HTTP/1.1 Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv00_LGNRpoSL0chtM7nPdAoRAaHLDARhqFK__6N2u4thnit2xRYwVOv4A7mzN0eBF8d6RdBsJfm5jkPp79OafCbTTrAWDG36rSFfNdVU5SPjBkwD7JMgHNogg3HdZ5zmFkScK-jp3ZmD2l0n5wfCTUCHLSErFrqhOeI7uOCS_oiqCHU Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:40:52.771781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66ecca1332d04a0faf9ccbb60f958e22", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-DeleteServersTestJSON-938080055 Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 0b4c1e464c194939ac4ead76af5440fe Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.773082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '59b536cd-c30e-4d09-ac25-11cc3cff1d0d'} Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:40:52.773774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.774911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.776758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Returning 404 to user: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:40:52.776758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-12c9d97e-7089-4c43-a887-94af5ec12082 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 404 len: 111 microversion: 2.1 time: 0.032344 Jul 01 19:40:52.777220 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 239/473] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:52 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:52.884829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:52.885890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:52.896451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:52.897042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.898353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:52.898924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:52.914817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] HTTP exception thrown: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Request method failure captured: Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d/os-volume_attachments HTTP/1.1 Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00_LGNRpoSL0chtM7nPdAoRAaHLDARhqFK__6N2u4thnit2xRYwVOv4A7mzN0eBF8d6RdBsJfm5jkPp79OafCbTTrAWDG36rSFfNdVU5SPjBkwD7JMgHNogg3HdZ5zmFkScK-jp3ZmD2l0n5wfCTUCHLSErFrqhOeI7uOCS_oiqCHU Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:40:52.925449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66ecca1332d04a0faf9ccbb60f958e22", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-DeleteServersTestJSON-938080055 Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 0b4c1e464c194939ac4ead76af5440fe Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.926844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'server_id': '59b536cd-c30e-4d09-ac25-11cc3cff1d0d'} Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:40:52.929911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:40:52.931867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:40:52.932945 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Returning 404 to user: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:40:52.932945 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c118b272-ffac-4355-ae06-df7dbb03b891 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046191 Jul 01 19:40:52.932945 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 235/474] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:40:52 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:40:53.132869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:53.133838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:53.141199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:53.141830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:53.148289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:53.149825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:53.292634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:53.300794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a669d218-bcdc-4759-8baa-8c361b6c2978 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.175433 Jul 01 19:40:53.301505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 240/475] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:53 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:53.617356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:53.617979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:53.624748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:53.625202 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:53.625979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:53.626435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:53.760759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:53.772434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dfc56af0-7e5f-434e-8961-ef6bc4cd68f0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.158747 Jul 01 19:40:53.773255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 236/476] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:53 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:54.322054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:54.322885 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:54.333731 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:54.334559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:54.335810 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:54.336536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:54.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:54.487258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-afc290be-0cb6-4b5d-ba96-7154e7114ba8 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.171960 Jul 01 19:40:54.487821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 241/477] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:54 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:54.795467 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:54.796067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:54.803239 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:54.803672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:54.804457 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:54.804890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:54.941035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:54.948938 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-adfe6fe0-ab49-4d89-ac3f-dd3e09203105 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.158983 Jul 01 19:40:54.949480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 237/478] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:54 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:55.508990 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:55.509998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:55.518273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:55.518711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:55.519463 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:55.519883 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:55.654789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:55.662318 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90c79f39-8963-437a-8a43-17186cc770b7 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.160158 Jul 01 19:40:55.662873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 242/479] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:55 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:55.968118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:55.968731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:55.976016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:55.976499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:55.977308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:55.977764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:56.108447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:56.116084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f799d6a4-cf47-42c8-8231-ce9198db3cfd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.153075 Jul 01 19:40:56.116654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 238/480] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:55 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:56.683865 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:56.684600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:56.690943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:56.693221 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:56.693677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:56.694496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:56.694927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:56.840747 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:56.848609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1b589c95-799c-41e6-8607-dde115cf92e3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.171986 Jul 01 19:40:56.849170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 243/481] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:56 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:57.133858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:57.134535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:57.142674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:57.143131 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:57.143900 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:57.144337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:57.291170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:57.299389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7325ec0a-3797-4b7e-91aa-1ddc7c39d924 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.170225 Jul 01 19:40:57.299956 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 239/482] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:57 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:57.873782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:57.874791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:57.884896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:57.885637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:57.886933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:57.887646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:58.019231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:58.027003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-45cd49f6-ca80-43ca-8de3-db3eb31f35c3 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.159545 Jul 01 19:40:58.027581 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 244/483] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:57 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:58.320739 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:58.321360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:58.328216 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:58.328670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:58.329432 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:58.329864 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:58.460627 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:58.468345 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c248cea-b1a5-417e-b85a-ac4335d54eab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.151533 Jul 01 19:40:58.468910 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 240/484] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:58 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:58.712595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-4807636f-f75a-4555-a064-5065bc3982a5 req-394e062f-1f64-479b-bf5b-a3d5b71aaa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bf2316-2508-413e-9761-2795b257c84c", "name": "network-vif-plugged", "status": "completed", "tag": "27f96ab5-aa7a-44be-a6e8-95a88f08f450"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:40:58.720756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4807636f-f75a-4555-a064-5065bc3982a5 req-394e062f-1f64-479b-bf5b-a3d5b71aaa72 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:58.721202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-4807636f-f75a-4555-a064-5065bc3982a5 req-394e062f-1f64-479b-bf5b-a3d5b71aaa72 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:58.733242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-4807636f-f75a-4555-a064-5065bc3982a5 req-394e062f-1f64-479b-bf5b-a3d5b71aaa72 service nova] Creating event network-vif-plugged:27f96ab5-aa7a-44be-a6e8-95a88f08f450 for instance f3bf2316-2508-413e-9761-2795b257c84c on hv-cinder-83124 Jul 01 19:40:58.738286 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-4807636f-f75a-4555-a064-5065bc3982a5 req-394e062f-1f64-479b-bf5b-a3d5b71aaa72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029408 Jul 01 19:40:58.738879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 245/485] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:40:59.047884 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:59.048502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:59.055672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:59.056053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:59.056833 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:59.057267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:59.199208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:59.209596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e505022e-2fbc-441a-a06e-eee4db983756 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.166695 Jul 01 19:40:59.210213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 241/486] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:59 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:40:59.485732 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:40:59.486454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:40:59.493042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:59.493485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:59.494284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:40:59.494720 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:40:59.627431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:40:59.635311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8842dc3-b1ee-4436-ae2a-55d4d427249e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.153856 Jul 01 19:40:59.635884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 246/487] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:40:59 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:00.227981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:00.228578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:00.235456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.235906 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.236702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.237134 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.371486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:00.379437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ca75695d-469b-46c1-ba74-262b16c9c69d tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1313 microversion: 2.1 time: 0.155561 Jul 01 19:41:00.381997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 242/488] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:00 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:00.539690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:00.540206 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:00.546240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.546691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.547454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.547891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.561766 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] HTTP exception thrown: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Request method failure captured: Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d HTTP/1.1 Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv00_LGNRpoSL0chtM7nPdAoRAaHLDARhqFK__6N2u4thnit2xRYwVOv4A7mzN0eBF8d6RdBsJfm5jkPp79OafCbTTrAWDG36rSFfNdVU5SPjBkwD7JMgHNogg3HdZ5zmFkScK-jp3ZmD2l0n5wfCTUCHLSErFrqhOeI7uOCS_oiqCHU Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:41:00.564317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66ecca1332d04a0faf9ccbb60f958e22", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-DeleteServersTestJSON-938080055 Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 0b4c1e464c194939ac4ead76af5440fe Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.565602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '59b536cd-c30e-4d09-ac25-11cc3cff1d0d'} Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:41:00.566325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.567448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.568565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Returning 404 to user: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:41:00.568565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6d3f6db8-151f-49a6-8411-1553fba2428b tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jul 01 19:41:00.568565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 247/489] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:41:00 2022] DELETE /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:41:00.575103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:00.575713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] [instance: 59b536cd-c30e-4d09-ac25-11cc3cff1d0d] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:00.582027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.582478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.583294 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.583728 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.597174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] HTTP exception thrown: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Request method failure captured: Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d HTTP/1.1 Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00_LGNRpoSL0chtM7nPdAoRAaHLDARhqFK__6N2u4thnit2xRYwVOv4A7mzN0eBF8d6RdBsJfm5jkPp79OafCbTTrAWDG36rSFfNdVU5SPjBkwD7JMgHNogg3HdZ5zmFkScK-jp3ZmD2l0n5wfCTUCHLSErFrqhOeI7uOCS_oiqCHU Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:41:00.599343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66ecca1332d04a0faf9ccbb60f958e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66ecca1332d04a0faf9ccbb60f958e22", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-DeleteServersTestJSON-938080055 Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 66ecca1332d04a0faf9ccbb60f958e22 Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-DeleteServersTestJSON-938080055 Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 0b4c1e464c194939ac4ead76af5440fe Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-DeleteServersTestJSON-938080055-project Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.600694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '59b536cd-c30e-4d09-ac25-11cc3cff1d0d'} Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:41:00.601406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. Jul 01 19:41:00.602827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:00.603986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] Returning 404 to user: Instance 59b536cd-c30e-4d09-ac25-11cc3cff1d0d could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:41:00.603986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f7238ee3-7f19-4db8-af71-83455d3d9c77 tempest-DeleteServersTestJSON-938080055 tempest-DeleteServersTestJSON-938080055-project] 10.222.0.61 "GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d" status: 404 len: 111 microversion: 2.1 time: 0.029876 Jul 01 19:41:00.603986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 243/490] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:00 2022] GET /compute/v2.1/servers/59b536cd-c30e-4d09-ac25-11cc3cff1d0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:41:00.652461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:00.653035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:00.659364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.659806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.660552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:00.660984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:00.874869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:00.882727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a2d1edb-82c0-49ef-8fda-adfc45b233e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.234134 Jul 01 19:41:00.883299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 248/491] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:00 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:01.397132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:01.398410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:01.404691 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:01.405132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:01.405889 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:01.406340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:01.677514 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:01.685734 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ed6d89c5-77fa-4524-b3ce-bf1d89fb2b41 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1497 microversion: 2.1 time: 0.292650 Jul 01 19:41:01.686414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 244/492] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:01 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1497 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:01.906037 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:01.906686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:01.912986 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:01.913463 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:01.914395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:01.914831 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:02.204501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:02.213881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5f0d5f60-5015-4fa2-85b6-0172c6ce6f6c tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.311463 Jul 01 19:41:02.214866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 249/493] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:01 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:02.363804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:02.364439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:02.370750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:02.371327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:02.372212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:02.372821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:02.397353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:41:02.448860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:02.483151 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c8af370-0eb6-4b57-8ea0-ac1b3a2d3b9b tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 204 len: 0 microversion: 2.1 time: 0.122870 Jul 01 19:41:02.483985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 245/494] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:41:02 2022] DELETE /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:41:02.495579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:02.496298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:02.503380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:02.504059 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:02.505106 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:02.505601 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:02.793249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:02.803211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-675de094-0957-4a7d-991f-4221eb3814bf tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1503 microversion: 2.1 time: 0.314309 Jul 01 19:41:02.804899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 250/495] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:02 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:03.232443 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:03.233149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:03.240783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:03.241438 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:03.242249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:03.242687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:03.475807 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:03.495482 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e59183d0-3b69-4aae-a299-050adcb68622 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.261813 Jul 01 19:41:03.496252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 246/496] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:03 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:03.821619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:03.822283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:03.830168 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:03.830610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:03.831373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:03.831798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:04.089564 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:04.102458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-520192a2-a9f2-4a43-afa1-e1986cfb8d62 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1503 microversion: 2.1 time: 0.279487 Jul 01 19:41:04.103118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 251/497] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:03 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:04.513787 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:04.514551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:04.521192 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:04.521634 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:04.522424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:04.522856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:05.061688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:05.073940 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0199618c-cfc3-4851-88e8-281129f5e4ad tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.563562 Jul 01 19:41:05.075197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 247/498] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:04 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:05.120174 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:05.121400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:05.130588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:05.131340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:05.132210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:05.132946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:05.335696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:05.342464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5e26c58-bc75-4845-9b2d-1d8bcaff6d89 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1503 microversion: 2.1 time: 0.226038 Jul 01 19:41:05.354047 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 252/499] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:05 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:05.440800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-ce4569cb-2c02-4dd6-a923-7e58cb6a5154 req-3278b398-877e-41ba-8b9c-0d781e10754d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bf2316-2508-413e-9761-2795b257c84c", "name": "network-vif-deleted", "tag": "27f96ab5-aa7a-44be-a6e8-95a88f08f450"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:05.455486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ce4569cb-2c02-4dd6-a923-7e58cb6a5154 req-3278b398-877e-41ba-8b9c-0d781e10754d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:05.456047 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ce4569cb-2c02-4dd6-a923-7e58cb6a5154 req-3278b398-877e-41ba-8b9c-0d781e10754d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:05.467691 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-ce4569cb-2c02-4dd6-a923-7e58cb6a5154 req-3278b398-877e-41ba-8b9c-0d781e10754d service nova] Creating event network-vif-deleted:27f96ab5-aa7a-44be-a6e8-95a88f08f450 for instance f3bf2316-2508-413e-9761-2795b257c84c on hv-cinder-83124 Jul 01 19:41:05.473311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-ce4569cb-2c02-4dd6-a923-7e58cb6a5154 req-3278b398-877e-41ba-8b9c-0d781e10754d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036660 Jul 01 19:41:05.474377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 248/500] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:06.092247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:06.093547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:06.100495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:06.101167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:06.102562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:06.103218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:06.122240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:06.254202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:06.262252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5884dbb-be16-4da9-975d-3f228e3e7e0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.173959 Jul 01 19:41:06.273363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 253/501] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:06 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:06.361207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:06.361901 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:06.380464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:06.381639 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:06.384563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:06.385099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:06.477653 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:06.485793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-63b3c8d9-22af-4889-bb8a-6793a11fd902 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1461 microversion: 2.1 time: 0.129071 Jul 01 19:41:06.486523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 249/502] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:06 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1461 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:07.279546 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:07.280381 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:07.288036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:07.288464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:07.289221 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:07.289671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:07.426896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:07.434726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f6c2e0b4-f92c-45ff-8305-b92da1e2d084 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.159039 Jul 01 19:41:07.435287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 254/503] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:07 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:07.503781 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:07.504418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:07.511387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:07.511840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:07.512607 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:07.513041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:07.546775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:07.547222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:07.547672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lazy-loading 'fault' on Instance uuid f3bf2316-2508-413e-9761-2795b257c84c {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:41:07.588735 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d8523e71264696997f23122115687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd410d5a356243c6b7b71cfb958fcdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:07.596118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fdfb743a-19c5-435f-b6fc-5f10fe2b474f tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 200 len: 1303 microversion: 2.1 time: 0.096182 Jul 01 19:41:07.596683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 250/504] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:07 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:08.452007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:08.452758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:08.459893 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:08.460322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:08.461260 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:08.461698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:08.601636 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:08.613308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:08.613922 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] [instance: f3bf2316-2508-413e-9761-2795b257c84c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:08.621064 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:08.623770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7bb3f944-1ca5-42b2-ba39-4ebbc94a907e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.176060 Jul 01 19:41:08.624366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 255/505] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:08 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:08.624991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:08.625982 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:08.626422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:08.641541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] HTTP exception thrown: Instance f3bf2316-2508-413e-9761-2795b257c84c could not be found. Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Request method failure captured: Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c HTTP/1.1 Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv01pqJ1rFrbsvt5sFaBijRs8UahhEmMTxAm6WGwKfLT3RYmhSG_NDPynn_e_JfcZ1WuInATJM2lFrLe8mYFlDS7JXiJqqgxtqC0gs-EkFnq-i9FIGbKbYj3DvNs4Su45_U9IlO9bx3bZon26CNjZiiYu76rfdys4NvuPrtRcGpmRScE Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: fd410d5a356243c6b7b71cfb958fcdfc Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesActionsTest-398598798 Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:41:08.643570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd410d5a356243c6b7b71cfb958fcdfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd410d5a356243c6b7b71cfb958fcdfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd410d5a356243c6b7b71cfb958fcdfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd410d5a356243c6b7b71cfb958fcdfc", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesActionsTest-398598798 Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: fd410d5a356243c6b7b71cfb958fcdfc Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesActionsTest-398598798 Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesActionsTest-398598798-project Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: c8d8523e71264696997f23122115687a Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesActionsTest-398598798-project Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance f3bf2316-2508-413e-9761-2795b257c84c could not be found. Jul 01 19:41:08.644834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'f3bf2316-2508-413e-9761-2795b257c84c'} Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3bf2316-2508-413e-9761-2795b257c84c could not be found. Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:41:08.645778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3bf2316-2508-413e-9761-2795b257c84c could not be found. Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3bf2316-2508-413e-9761-2795b257c84c could not be found. Jul 01 19:41:08.647028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:41:08.648888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] Returning 404 to user: Instance f3bf2316-2508-413e-9761-2795b257c84c could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:41:08.649876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-29fd8e77-49f0-4c57-9369-3cf7435712a0 tempest-VolumesActionsTest-398598798 tempest-VolumesActionsTest-398598798-project] 10.222.0.61 "GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c" status: 404 len: 111 microversion: 2.1 time: 0.040910 Jul 01 19:41:08.650660 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 251/506] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:08 2022] GET /compute/v2.1/servers/f3bf2316-2508-413e-9761-2795b257c84c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:41:08.936384 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6071e54a-ce28-4d14-bee1-6cc531e96fd0 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764a00b80>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:08.998467 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6071e54a-ce28-4d14-bee1-6cc531e96fd0 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/353c767f-66a9-4f1c-b2b0-e44656b9b841" status: 200 len: 350 microversion: 2.1 time: 0.066299 Jul 01 19:41:08.999307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 256/507] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:41:08 2022] GET /compute/v2.1/os-volumes/353c767f-66a9-4f1c-b2b0-e44656b9b841 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:09.643111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:09.644365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:09.651401 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.651863 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.652868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.653495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.791495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:09.799267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-42535ba0-6fb5-4bd8-a51c-10c0be6a9482 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1502 microversion: 2.1 time: 0.162504 Jul 01 19:41:09.799828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 252/508] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:09 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:09.815926 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24395e8b-925c-4f06-a82f-53fd712af292"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:09.817228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:09.823739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.824258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.825110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.825642 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.848431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] HTTP exception thrown: Cannot 'attach_volume' instance 061b75be-e4ba-4cb7-b74a-3373e5495283 while it is in vm_state rescued Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Request method failure captured: Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/os-volume_attachments HTTP/1.1 Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 74 Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv002nx8fsanozFIk_k9JzkgEqUOE9MB3q4Lv6Te5dr16vSvMXmyEulASNznKW0X1Yo2TxPfZZaeHYdqdGlmS9vxnvSitealY4CfvTbjF-k5_qO9rOhW0pPOMnYPmYoQsUkoPz01VhB_IirGGMzYdIOgTSTL5XXVIPhuRYZa6H8TmtnY Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:41:09.850630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd397adb95a6455b8e78db9b132d865e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: bf5ff69a857f412fb65dce1b59a22e9d Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {"volumeAttachment": {"volumeId": "24395e8b-925c-4f06-a82f-53fd712af292"}} Jul 01 19:41:09.851806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Cannot 'attach_volume' instance 061b75be-e4ba-4cb7-b74a-3373e5495283 while it is in vm_state rescued Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '061b75be-e4ba-4cb7-b74a-3373e5495283', 'body': {'volumeAttachment': {'volumeId': '24395e8b-925c-4f06-a82f-53fd712af292'}}} Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:41:09.852818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 061b75be-e4ba-4cb7-b74a-3373e5495283 while it is in vm_state rescued Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:41:09.856354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 061b75be-e4ba-4cb7-b74a-3373e5495283 while it is in vm_state rescued Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Returning 409 to user: Cannot 'attach_volume' instance 061b75be-e4ba-4cb7-b74a-3373e5495283 while it is in vm_state rescued {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6c2ef4f6-98f5-4f1b-94e0-7c609241e11e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040389 Jul 01 19:41:09.857619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 257/509] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:41:09 2022] POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 01 19:41:09.863818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:09.864534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:09.870811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.871341 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.872174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.872678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.948024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-74ee2cdc-ed60-4dfa-86f9-ce079a6ec63a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/action" status: 202 len: 0 microversion: 2.1 time: 0.087859 Jul 01 19:41:09.949310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 253/510] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:41:09 2022] POST /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:41:09.958207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:09.959186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:09.965686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.966694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:09.967580 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:09.968340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:10.203495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:10.211265 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-71e2973e-db2d-43a3-b48c-e07394d39c1e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.257199 Jul 01 19:41:10.211985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 258/511] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:09 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:10.518273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1e6a31b2-fde4-4d90-8a55-e0492efdfa92 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764a7c700>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:10.605549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1e6a31b2-fde4-4d90-8a55-e0492efdfa92 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fc0682dc-2d7f-48c5-ac90-84e90abca7f3" status: 200 len: 351 microversion: 2.1 time: 0.092114 Jul 01 19:41:10.606261 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 254/512] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:41:10 2022] GET /compute/v2.1/os-volumes/fc0682dc-2d7f-48c5-ac90-84e90abca7f3 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:11.230592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:11.231961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:11.238345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:11.238912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:11.239997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:11.240516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:11.419920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:11.429051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-69512d6c-0642-4cb4-a926-2f71dc0ff6f2 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.203412 Jul 01 19:41:11.430186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 259/513] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:11 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:12.447325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:12.449099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:12.455987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:12.456431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:12.457214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:12.457643 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:12.596671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:12.605359 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ecb03d79-c2c1-47dc-8b79-f802ac823cab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.162648 Jul 01 19:41:12.606030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 255/514] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:12 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:13.624640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:13.625889 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:13.633364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:13.633920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:13.634743 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:13.635344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:13.902890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:13.911428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a7d58953-70bd-4ebf-9cc6-99b72ff219cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.292010 Jul 01 19:41:13.912001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 260/515] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:13 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:14.930045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:14.930681 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:14.941568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:14.941937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:14.943317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:14.944272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:15.181913 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:15.219716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0876bf4d-9290-4be2-9452-68dbcc86d0b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.294550 Jul 01 19:41:15.229513 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 256/516] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:14 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:41:16.237514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:16.238367 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:16.244612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:16.245201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:16.246228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:16.246927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:16.378993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cf55ca7f-b2e9-46ab-8cef-5fe263cab0b1 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764992160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:16.486448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cf55ca7f-b2e9-46ab-8cef-5fe263cab0b1 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3f1ff3d7-684e-46bf-805c-7d441cdd8dbf" status: 200 len: 350 microversion: 2.1 time: 0.118453 Jul 01 19:41:16.487426 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 257/517] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:41:16 2022] GET /compute/v2.1/os-volumes/3f1ff3d7-684e-46bf-805c-7d441cdd8dbf => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:16.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bafa6401-43c3-447b-a778-6ccc553d72ac tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f476498c0d0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:16.530529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:16.542329 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d3a3b0e1-bc1f-4111-85f3-ca011da230c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.308195 Jul 01 19:41:16.557614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 261/518] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:16 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:16.685308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bafa6401-43c3-447b-a778-6ccc553d72ac tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.190429 Jul 01 19:41:16.693162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 258/519] 10.222.0.61 () {58 vars in 1133 bytes} [Fri Jul 1 19:41:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:16.699139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f2ea79f7-f718-46b2-be19-20e581f6c439 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764a00940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:16.856191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f2ea79f7-f718-46b2-be19-20e581f6c439 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.161471 Jul 01 19:41:16.857401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 262/520] 10.222.0.61 () {58 vars in 1148 bytes} [Fri Jul 1 19:41:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:16.870780 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d3484e35-b4d3-4733-a145-6fb8dade0053 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f476498bee0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.065012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d3484e35-b4d3-4733-a145-6fb8dade0053 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.199337 Jul 01 19:41:17.066279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 259/521] 10.222.0.61 () {58 vars in 1133 bytes} [Fri Jul 1 19:41:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:17.078866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ff7c5015-aa6f-49d8-9e7f-ad68860f2c11 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764a1ea60>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.238746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ff7c5015-aa6f-49d8-9e7f-ad68860f2c11 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.164621 Jul 01 19:41:17.239702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 263/522] 10.222.0.61 () {58 vars in 1166 bytes} [Fri Jul 1 19:41:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:17.255431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-16775144-8bf6-4257-ad84-3e073da0553c tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764abca60>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.404728 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-16775144-8bf6-4257-ad84-3e073da0553c tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155223 Jul 01 19:41:17.405299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 260/523] 10.222.0.61 () {58 vars in 1169 bytes} [Fri Jul 1 19:41:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:17.419008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-37410ff5-73da-4ab1-a564-2da67ac3c572 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764a1e940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.561956 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.562577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:17.570364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:17.572016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:17.572595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:17.573724 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:17.582516 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:17.603496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-37410ff5-73da-4ab1-a564-2da67ac3c572 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.188266 Jul 01 19:41:17.604601 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 264/524] 10.222.0.61 () {58 vars in 1154 bytes} [Fri Jul 1 19:41:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:17.615937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3dd1a424-5909-4b28-9536-3903cb843bd9 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f4764a1eca0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.813823 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3dd1a424-5909-4b28-9536-3903cb843bd9 tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.201632 Jul 01 19:41:17.816652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 265/525] 10.222.0.61 () {58 vars in 1187 bytes} [Fri Jul 1 19:41:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:17.829474 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-11584497-c409-4ab2-b1d0-d5ed06644a6d tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] Calling method '.version_select at 0x7f47649b3b80>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:17.866565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:17.892727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fd6151cc-4d13-4b1f-a2bf-1f43d034fb92 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1510 microversion: 2.1 time: 0.330109 Jul 01 19:41:17.893720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 261/526] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:17 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:41:18.026366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-11584497-c409-4ab2-b1d0-d5ed06644a6d tempest-VolumesTestJSON-601055076 tempest-VolumesTestJSON-601055076-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.201450 Jul 01 19:41:18.027780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 266/527] 10.222.0.61 () {58 vars in 1154 bytes} [Fri Jul 1 19:41:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:18.447622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-913b797f-711e-4541-964d-9232f3ce26c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Action: 'create', calling method: .version_select at 0x7f47649caca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1560650810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdb/MaQ/ERN1YlOzxVGjRVAyR/lgfA1ol5mAU+n13tXoQ9bN4iu8Q9y/QAPjrKz73W/NGmlNugUgwFvdALhHC/nCQXwovT+Ga4j+8Uo30cn1lRfiSC+8WRaex+xVSDLPg=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:18.479654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-913b797f-711e-4541-964d-9232f3ce26c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Getting quotas for project c1d1142c18b54c03a1106fb2d1f1b7ec. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:41:18.491963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-913b797f-711e-4541-964d-9232f3ce26c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Getting quotas for user 44e3430faccb4db28f9439ac4e13cf26 and project c1d1142c18b54c03a1106fb2d1f1b7ec. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:41:18.532578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-913b797f-711e-4541-964d-9232f3ce26c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.388566 Jul 01 19:41:18.533716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 262/528] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:41:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:41:18.913844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:18.915343 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:18.927109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:18.927573 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:18.928363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:18.928798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:19.251131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:19.259808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4f530362-a2e6-44ab-9801-8471f5a9364e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1516 microversion: 2.1 time: 0.352540 Jul 01 19:41:19.263822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 267/529] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:18 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:20.870984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6789b2e0-e315-4992-b1a2-a23530bf8070 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'create', calling method: .version_select at 0x7f476498bc10>, body: {"keypair": {"name": "tempest-keypair-1391804274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuXUzrUH92OZESPLB12/hYifbfVD0f3G7HqRsI0eaIag/pIAC3GoCgEMSsbfKNLfUCIHfyIQELq2U+QoYRywUVLjyg77VkexrB0rn3TeirQxeV+2IqpJWjIyIdLAPEfnQ=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:20.904891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-6789b2e0-e315-4992-b1a2-a23530bf8070 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for project bd397adb95a6455b8e78db9b132d865e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:41:20.910687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-6789b2e0-e315-4992-b1a2-a23530bf8070 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for user bf5ff69a857f412fb65dce1b59a22e9d and project bd397adb95a6455b8e78db9b132d865e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:41:20.953515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6789b2e0-e315-4992-b1a2-a23530bf8070 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087012 Jul 01 19:41:20.955273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 263/530] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:41:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:23.324014 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1827013581", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68e50c5c-73f8-4467-8a5f-30c75d4029ae"}], "security_groups": [{"name": "tempest-securitygroup--1197264595"}], "key_name": "tempest-keypair-1391804274", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:29.256060 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=49 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:33.355338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=39 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:38.591988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] validate_networks() for [('68e50c5c-73f8-4467-8a5f-30c75d4029ae', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:41:38.973549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:41:38.973868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:41:38.974448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:41:38.974901 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:41:38.975294 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:41:38.987609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:38.988059 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:38.989017 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:38.989598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:39.008948 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for project bd397adb95a6455b8e78db9b132d865e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:41:39.014132 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Getting quotas for user bf5ff69a857f412fb65dce1b59a22e9d and project bd397adb95a6455b8e78db9b132d865e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:41:39.026025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:41:39.028319 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:41:39.076378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [9e6d4a3c-1b2c-4c1d-9ca7-8c8238ff2037] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 19:41:40.086365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [9e6d4a3c-1b2c-4c1d-9ca7-8c8238ff2037] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 56156. Jul 01 19:41:40.093486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5c56efb-ed37-44aa-8e41-7d47287131b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 16.773884 Jul 01 19:41:40.095455 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 268/531] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:41:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 16776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:41:40.106681 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:40.108059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=8 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:40.109460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:40.116447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a95f32cb-b612-4ed9-a9ec-37cb920d47e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:40.117421 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a95f32cb-b612-4ed9-a9ec-37cb920d47e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:40.188454 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a95f32cb-b612-4ed9-a9ec-37cb920d47e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:40.195676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a95f32cb-b612-4ed9-a9ec-37cb920d47e1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1246 microversion: 2.1 time: 0.091621 Jul 01 19:41:40.196416 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 264/532] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:40 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:41.213372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f7ad4616-fe0f-425e-a265-e0861a7a357f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:41.213929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f7ad4616-fe0f-425e-a265-e0861a7a357f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:41.266776 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f7ad4616-fe0f-425e-a265-e0861a7a357f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:41.273478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f7ad4616-fe0f-425e-a265-e0861a7a357f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1246 microversion: 2.1 time: 0.064575 Jul 01 19:41:41.274058 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 269/533] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:41 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:42.290617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b9c37abb-425b-4bb8-8e01-45412a4a9ddf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:42.292258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b9c37abb-425b-4bb8-8e01-45412a4a9ddf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:42.355165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b9c37abb-425b-4bb8-8e01-45412a4a9ddf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:42.362993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b9c37abb-425b-4bb8-8e01-45412a4a9ddf tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1246 microversion: 2.1 time: 0.076673 Jul 01 19:41:42.371847 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 265/534] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:42 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:43.379867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cdadf9eb-2f1a-48eb-9867-53bd29ef7eca tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:43.380476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cdadf9eb-2f1a-48eb-9867-53bd29ef7eca tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:43.447385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cdadf9eb-2f1a-48eb-9867-53bd29ef7eca tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:43.457006 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cdadf9eb-2f1a-48eb-9867-53bd29ef7eca tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1246 microversion: 2.1 time: 0.080851 Jul 01 19:41:43.457961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 270/535] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:43 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:44.476763 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:44.477365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:44.485102 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:44.485584 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:44.486518 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:44.487003 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:44.549838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:44.557423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-81beb017-2e87-4e71-a1b8-230fadcc647a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1250 microversion: 2.1 time: 0.086032 Jul 01 19:41:44.557973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 266/536] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:44 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:45.574974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:45.575628 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:45.581928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:45.582385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:45.583138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:45.583571 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:45.650863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:45.659578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e27d95a9-a2bd-413e-9838-9a121775f7cc tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1298 microversion: 2.1 time: 0.088818 Jul 01 19:41:45.660385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 271/537] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:45 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:46.676590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:46.677236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:46.684524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:46.685239 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:46.686056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:46.686471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:46.915024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:46.923639 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ae29a06a-3565-40f7-b7b5-6718cd9e4eff tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.250851 Jul 01 19:41:46.924299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 267/538] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:46 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:47.238184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-b6c8e07b-e6df-440c-beac-6926d590bb5e req-e53060dd-68bd-44f6-80b0-94e94932b923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107094b7-ca95-4b66-b984-2359f2ef2a51", "tag": "7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:41:47.247856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b6c8e07b-e6df-440c-beac-6926d590bb5e req-e53060dd-68bd-44f6-80b0-94e94932b923 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:47.248307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b6c8e07b-e6df-440c-beac-6926d590bb5e req-e53060dd-68bd-44f6-80b0-94e94932b923 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:47.259852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-b6c8e07b-e6df-440c-beac-6926d590bb5e req-e53060dd-68bd-44f6-80b0-94e94932b923 service nova] Creating event network-changed:7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12 for instance 107094b7-ca95-4b66-b984-2359f2ef2a51 on hv-cinder-83124 Jul 01 19:41:47.264913 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-b6c8e07b-e6df-440c-beac-6926d590bb5e req-e53060dd-68bd-44f6-80b0-94e94932b923 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030796 Jul 01 19:41:47.265834 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 272/539] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:41:47.940895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:47.941455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:47.949001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:47.949448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:47.950261 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:47.950690 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:48.091610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:48.100289 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0c2125f3-d768-410b-8c34-fe0dc21b197a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.163222 Jul 01 19:41:48.101049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 268/540] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:47 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:49.114063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:49.118439 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:49.119136 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:49.125623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:49.126092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:49.126850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:49.127278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:49.260946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:49.272566 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2ac1aa35-dacb-43c1-ab4e-c92906f1e061 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.159555 Jul 01 19:41:49.273135 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 273/541] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:49 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:49.533125 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:41:49.533279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 19:41:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:41:50.293767 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:50.294654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:50.304919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:50.305367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:50.306248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:50.306684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:50.449424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:50.458816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ce14c842-7312-4078-a280-6dfb1032e984 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.171721 Jul 01 19:41:50.459385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 269/542] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:50 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:51.482652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:51.483652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:51.494142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:51.494836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:51.496118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:51.496835 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:51.644607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:51.652591 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dbb6af66-ddad-47ef-953f-6b8385251228 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.176373 Jul 01 19:41:51.653131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 274/543] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:51 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:52.669701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:52.670351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:52.672702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:52.677979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:52.678448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:52.679206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:52.679642 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:52.805853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:52.813753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0647c757-dac3-4ecd-a9b1-002731c53297 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.148002 Jul 01 19:41:52.814358 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 270/544] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:52 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:53.831225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:53.831834 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:53.833801 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:53.839006 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:53.839458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:53.840223 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:53.840658 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:53.978011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:53.989518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc731bb4-e34b-49e6-8ea0-6b2b08f507bb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.161864 Jul 01 19:41:53.990395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 275/545] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:53 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:55.008862 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:55.009527 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:55.016311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:55.016765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:55.017523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:55.018079 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:55.165968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:55.173974 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3964fe6-7464-43ae-9cbf-1c880803cbf4 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.169053 Jul 01 19:41:55.174552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 271/546] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:55 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:56.198453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:56.199003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:56.205162 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:56.205610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:56.206403 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:56.206818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:56.338740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:56.346493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-be7ed290-89e0-4b08-b5fc-4d3e565a1964 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.156826 Jul 01 19:41:56.347064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 276/547] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:56 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:57.367179 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:57.367764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:57.375433 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:57.375874 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:57.376662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:57.377091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:57.527251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:57.535519 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6387b04d-dbbc-4e12-9fbf-9e25bf524189 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.173956 Jul 01 19:41:57.544929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 272/548] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:57 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:41:58.552497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:58.553163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:58.559675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:58.560120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:58.560869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:58.561304 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:58.689826 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:58.702421 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-10c25414-888a-4370-a3d1-2135d7a5f3b6 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.153558 Jul 01 19:41:58.703283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 277/549] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:58 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:41:59.719344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:41:59.719988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:41:59.726998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:59.727450 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:59.728226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:41:59.728663 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:41:59.861491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:41:59.872154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fb9e6622-425d-4ffa-90b9-04e4c8e2d739 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.156706 Jul 01 19:41:59.872693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 273/550] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:41:59 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:00.892669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:00.893247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:00.903023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:00.903779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:00.904557 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:00.904987 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:00.907540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=41 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:01.036955 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:01.048364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5646d569-64f7-42b9-a6ed-8e71fccf8684 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.161710 Jul 01 19:42:01.049121 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 278/551] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:00 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:02.065059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:02.065722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:02.074203 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:02.074659 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:02.075472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:02.075928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:02.217702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:02.225325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3daeaea7-2bce-4858-869d-809b85608f95 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.164193 Jul 01 19:42:02.225871 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 274/552] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:02 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:03.246580 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:03.247564 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:03.254989 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:03.255432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:03.256394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:03.256821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:03.384881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:03.393120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-15668418-2a2b-4246-a939-b0051e6ac1b5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.153370 Jul 01 19:42:03.393683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 279/553] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:03 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:04.413553 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:04.414198 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:04.422356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:04.422811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:04.423581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:04.424014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:04.570537 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:04.578762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f887a4fd-492d-4176-bc3b-7940cc05e6f9 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.169081 Jul 01 19:42:04.579331 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 275/554] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:04 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:05.594984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:05.595587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:05.598641 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:05.602923 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:05.603371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:05.604196 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:05.604640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:05.741276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:05.751142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-58fc044c-a2d6-4fbf-b5b8-975c813fca12 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.159957 Jul 01 19:42:05.752495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 280/555] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:05 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:06.773309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:06.774345 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:06.783738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:06.784191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:06.784961 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:06.785393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:06.915813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:06.924258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-faca3ce6-fa36-4787-8b69-d290627a2a81 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.157383 Jul 01 19:42:06.924843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 276/556] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:06 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:07.943655 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:07.944241 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:07.953468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:07.953915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:07.954711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:07.955149 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:08.092927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:08.101169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-acdd02c6-6a03-458a-b100-424f4c8638b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.163736 Jul 01 19:42:08.101803 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 281/557] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:07 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:09.118722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:09.119331 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:09.125891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:09.126364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:09.127121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:09.127544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:09.255495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:09.266648 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5bbd1339-13a7-4771-9dab-9b65c2276d1a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.151505 Jul 01 19:42:09.267437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 277/558] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:09 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:10.289857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:10.290502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:10.297071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:10.297498 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:10.298914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:10.299362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:10.432890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:10.440727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b3183afd-94ab-4fab-9048-ec91af084f3b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.155401 Jul 01 19:42:10.441382 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 282/559] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:10 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:11.071913 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-514046670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1560650810", "security_groups": [{"name": "tempest-secgroup-smoke-1159437825"}], "networks": [{"uuid": "ce54f0a1-afd3-4a06-a9bb-92a513ae4e6c"}], "block_device_mapping_v2": [{"uuid": "b230af6e-68e9-4a4c-a027-50d39851b60c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:42:11.081292 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=33 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:11.426531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] validate_networks() for [('ce54f0a1-afd3-4a06-a9bb-92a513ae4e6c', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:42:11.458970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:11.460281 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:11.466978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:11.467491 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:11.468259 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:11.468696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:11.687738 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:11.696847 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ad712307-3808-4992-a010-4903c7ae5e4a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.241577 Jul 01 19:42:11.698189 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 283/560] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:11 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:11.883110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d33d84dd-4407-475a-a2e6-52213956a5b5 req-5209b4ff-2703-48de-a811-37e0641ef975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107094b7-ca95-4b66-b984-2359f2ef2a51", "name": "network-vif-plugged", "status": "completed", "tag": "7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:42:11.894315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d33d84dd-4407-475a-a2e6-52213956a5b5 req-5209b4ff-2703-48de-a811-37e0641ef975 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:11.895365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d33d84dd-4407-475a-a2e6-52213956a5b5 req-5209b4ff-2703-48de-a811-37e0641ef975 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:11.897066 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:42:11.897492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:42:11.897993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:42:11.898741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:42:11.903644 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:42:11.909848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d33d84dd-4407-475a-a2e6-52213956a5b5 req-5209b4ff-2703-48de-a811-37e0641ef975 service nova] Creating event network-vif-plugged:7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12 for instance 107094b7-ca95-4b66-b984-2359f2ef2a51 on hv-cinder-83124 Jul 01 19:42:11.912824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:11.913276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:11.914106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:11.914546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:11.915242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d33d84dd-4407-475a-a2e6-52213956a5b5 req-5209b4ff-2703-48de-a811-37e0641ef975 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036672 Jul 01 19:42:11.915833 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 284/561] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:42:11.922209 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=73 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:11.933191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Getting quotas for project c1d1142c18b54c03a1106fb2d1f1b7ec. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:42:11.937156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Getting quotas for user 44e3430faccb4db28f9439ac4e13cf26 and project c1d1142c18b54c03a1106fb2d1f1b7ec. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:42:11.994265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:42:11.996372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b230af6e-68e9-4a4c-a027-50d39851b60c',volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:42:12.158567 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-159650ab-99c2-4426-8367-1fbc45f22184 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.090894 Jul 01 19:42:12.159581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 278/562] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:42:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:42:12.170648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d86f6125-e8b6-499a-a6e3-9bbe869f9826 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:12.171343 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d86f6125-e8b6-499a-a6e3-9bbe869f9826 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:12.238526 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d86f6125-e8b6-499a-a6e3-9bbe869f9826 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:12.246080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d86f6125-e8b6-499a-a6e3-9bbe869f9826 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1088 microversion: 2.1 time: 0.079764 Jul 01 19:42:12.246674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 285/563] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:12 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:12.717074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:12.717917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:12.725091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:12.725534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:12.726350 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:12.726784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:12.870504 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:12.880194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7fce48d4-e651-4be3-a1aa-ab5c6e9df446 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.167148 Jul 01 19:42:12.880870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 279/564] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:12 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:13.263764 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:13.264452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:13.271097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:13.271533 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:13.272293 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:13.272728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:13.335969 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:13.344148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f203e6bd-f9aa-41a8-bfc0-428907e8f8dd tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1138 microversion: 2.1 time: 0.084309 Jul 01 19:42:13.344795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 286/565] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:13 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:13.896916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:13.897523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:13.905572 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:13.906312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:13.907188 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:13.907678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:14.044528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:14.052098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-48bba598-2fcd-4bac-bb9e-45867e496346 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1372 microversion: 2.1 time: 0.159302 Jul 01 19:42:14.052750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 280/566] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:13 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:14.366177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:14.367159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:14.377393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:14.377837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:14.378629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:14.379060 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:14.440420 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:14.448463 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4ffbd190-e09c-4af6-855d-802ffdf29cf7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1186 microversion: 2.1 time: 0.089130 Jul 01 19:42:14.449032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 287/567] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:14 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:15.069109 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:15.070019 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:15.077549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:15.078675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:15.079667 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:15.080322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:15.229784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:15.243218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-20b9c650-66c4-4588-875c-c3fd5ad26304 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1566 microversion: 2.1 time: 0.177424 Jul 01 19:42:15.247224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 281/568] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:15 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:15.261265 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:15.261771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:15.268058 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:15.268504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:15.269572 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:15.270069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:15.386284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2b04b934-229e-415b-bf53-2e8687848824 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129429 Jul 01 19:42:15.387199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 288/569] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:42:15 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:42:15.466508 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:15.467135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:15.478404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:15.479200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:15.479786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:15.480272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:15.574713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:15.583377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-93c3aeda-2574-488d-bb10-3940ff239d66 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1204 microversion: 2.1 time: 0.121120 Jul 01 19:42:15.584247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 282/570] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:15 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:16.584997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2e644167-552b-4c56-ba02-0df6a05c0f5f req-70423254-d76a-4a95-b1b1-efa67d7875d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107094b7-ca95-4b66-b984-2359f2ef2a51", "tag": "7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:42:16.601986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:16.603408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:16.613856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2e644167-552b-4c56-ba02-0df6a05c0f5f req-70423254-d76a-4a95-b1b1-efa67d7875d8 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:16.614337 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2e644167-552b-4c56-ba02-0df6a05c0f5f req-70423254-d76a-4a95-b1b1-efa67d7875d8 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:16.619347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:16.622827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:16.624688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:16.625124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:16.652920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2e644167-552b-4c56-ba02-0df6a05c0f5f req-70423254-d76a-4a95-b1b1-efa67d7875d8 service nova] Creating event network-changed:7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12 for instance 107094b7-ca95-4b66-b984-2359f2ef2a51 on hv-cinder-83124 Jul 01 19:42:16.665232 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2e644167-552b-4c56-ba02-0df6a05c0f5f req-70423254-d76a-4a95-b1b1-efa67d7875d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084600 Jul 01 19:42:16.665984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 289/571] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:42:16.986045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:17.000412 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b579a2dd-2872-4080-bd96-ddb47fc25730 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.399426 Jul 01 19:42:17.001072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 283/572] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:16 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:17.109753 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2ea0f6fa-acdc-4098-86dc-1892c5075fa5 req-62b0190d-26d6-4ff6-81f4-b1728ae07297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:42:17.133256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2ea0f6fa-acdc-4098-86dc-1892c5075fa5 req-62b0190d-26d6-4ff6-81f4-b1728ae07297 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:17.133712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2ea0f6fa-acdc-4098-86dc-1892c5075fa5 req-62b0190d-26d6-4ff6-81f4-b1728ae07297 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:17.153368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2ea0f6fa-acdc-4098-86dc-1892c5075fa5 req-62b0190d-26d6-4ff6-81f4-b1728ae07297 service nova] Creating event network-changed:1e7ea8a1-39e7-4142-b19c-19006b3a3154 for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 on hv-cinder-83124 Jul 01 19:42:17.160392 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2ea0f6fa-acdc-4098-86dc-1892c5075fa5 req-62b0190d-26d6-4ff6-81f4-b1728ae07297 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054478 Jul 01 19:42:17.165203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 290/573] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:42:18.019328 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:18.020525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:18.027284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:18.027821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:18.029621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:18.029621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:18.220873 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:18.231337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b8b0f6b9-498d-403b-b1e7-9160fc203bbe tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.216139 Jul 01 19:42:18.235179 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 284/574] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:18 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:19.257746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:19.259270 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:19.266858 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:19.267308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:19.268446 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:19.269697 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:19.496496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:19.506534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-47d04dfa-fd3e-4997-9783-545aff0b7dd9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.253202 Jul 01 19:42:19.507328 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 291/575] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:19 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:20.526771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:20.528969 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:20.541700 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:20.542240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:20.543089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:20.543518 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:20.683541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:20.691331 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f3634800-b3e3-4e39-a3d3-f594ec5cb3d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.171029 Jul 01 19:42:20.691809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 285/576] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:20 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:21.708532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:21.709115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:21.715775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:21.716225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:21.716992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:21.717424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:21.853779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:21.861813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-30c012e0-93ae-46d9-a7b6-4d78fa6af92b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.157094 Jul 01 19:42:21.862569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 292/577] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:21 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:22.879532 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:22.880249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:22.882806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:22.883530 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:22.889875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:22.890521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:22.891278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:22.891686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:23.028451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:23.036492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ca7b74f4-ed4b-440d-a7fa-6025c90e3d9b tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.160697 Jul 01 19:42:23.045969 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 286/578] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:22 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:24.055143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:24.060516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:24.060516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:24.062356 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:24.062784 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:24.064118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:24.064118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:24.200428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:24.208787 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1c1faa51-6eae-412d-bb2b-11268e828fc6 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.159033 Jul 01 19:42:24.209536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 293/579] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:24 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:25.225402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:25.226142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:25.234821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:25.235243 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:25.236012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:25.236460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:25.389882 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:25.399380 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3923edaa-ed8d-466a-8834-5790f02c4849 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.178463 Jul 01 19:42:25.400166 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 287/580] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:25 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:26.416262 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:26.416951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:26.423483 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:26.423932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:26.424697 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:26.425130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:26.563018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:26.571012 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ad7c70c0-e6d1-4d6a-ab2d-ad221e5009ec tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.158585 Jul 01 19:42:26.571618 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 294/581] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:26 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:27.589256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:27.589939 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:27.596831 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:27.597893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:27.598718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:27.599222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:27.743894 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:27.752163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7943b2b8-8750-4cc0-a00e-151ee6614c2e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.166929 Jul 01 19:42:27.752714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 288/582] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:27 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:28.769682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:28.770422 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:28.778700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:28.779248 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:28.780094 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:28.780599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:29.170427 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:29.177989 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f1d6e971-c105-4649-910e-126cd4150ba4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.413092 Jul 01 19:42:29.178585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 295/583] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:28 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:30.200394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:30.202875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:30.207312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8b0fbd65-e67e-4aa4-a65a-d3be13f11e03 req-15a44c0a-1de7-4956-a929-83697a6649fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "name": "network-vif-plugged", "status": "completed", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:42:30.214857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:30.215608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:30.215724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b0fbd65-e67e-4aa4-a65a-d3be13f11e03 req-15a44c0a-1de7-4956-a929-83697a6649fa service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:30.216125 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b0fbd65-e67e-4aa4-a65a-d3be13f11e03 req-15a44c0a-1de7-4956-a929-83697a6649fa service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:30.216920 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:30.217568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:30.228477 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8b0fbd65-e67e-4aa4-a65a-d3be13f11e03 req-15a44c0a-1de7-4956-a929-83697a6649fa service nova] Creating event network-vif-plugged:1e7ea8a1-39e7-4142-b19c-19006b3a3154 for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 on hv-cinder-83124 Jul 01 19:42:30.236612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8b0fbd65-e67e-4aa4-a65a-d3be13f11e03 req-15a44c0a-1de7-4956-a929-83697a6649fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033595 Jul 01 19:42:30.237922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 296/584] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:42:30.357134 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:30.364676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dbbf3682-59cc-4f38-b3d9-ce19d2aa09d3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.172279 Jul 01 19:42:30.365270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 289/585] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:30 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:31.385238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:31.385929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:31.392550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:31.393080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:31.393736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:31.394195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:31.396946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=90 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:31.529195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:31.537771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-de1d3bb9-028f-4d5c-ab8a-12698f77630f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1260 microversion: 2.1 time: 0.158806 Jul 01 19:42:31.538724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 297/586] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:31 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:32.554857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:32.555428 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:32.562287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:32.562737 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:32.563496 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:32.563932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:32.699418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:32.707805 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-983aa9cc-9cd7-4bdd-a9c3-f4c791db10c9 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1445 microversion: 2.1 time: 0.156907 Jul 01 19:42:32.708449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 290/587] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:32 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:32.726390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:42:32.727002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:42:32.733693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:32.734114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:32.734876 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:32.735306 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:32.880227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:42:32.889572 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-806e5da3-a821-40c9-a01b-a4a2bf57f0b8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1445 microversion: 2.1 time: 0.167197 Jul 01 19:42:32.890446 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 298/588] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:42:32 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:42:34.681382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-2b5f82af-2e84-4847-acc4-ce62ab0baa5c req-1464f562-4409-45dd-8431-23dd7dbebb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:42:34.690087 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-2b5f82af-2e84-4847-acc4-ce62ab0baa5c req-1464f562-4409-45dd-8431-23dd7dbebb93 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:42:34.690528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-2b5f82af-2e84-4847-acc4-ce62ab0baa5c req-1464f562-4409-45dd-8431-23dd7dbebb93 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:42:34.702711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-2b5f82af-2e84-4847-acc4-ce62ab0baa5c req-1464f562-4409-45dd-8431-23dd7dbebb93 service nova] Creating event network-changed:1e7ea8a1-39e7-4142-b19c-19006b3a3154 for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 on hv-cinder-83124 Jul 01 19:42:34.707949 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-2b5f82af-2e84-4847-acc4-ce62ab0baa5c req-1464f562-4409-45dd-8431-23dd7dbebb93 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030237 Jul 01 19:42:34.708542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 291/589] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:01.444078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=39 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:01.446715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=11 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:01.451287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:01.451844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:01.460097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:01.460547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:01.461324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:01.461757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:01.486189 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0bca9e24-48e7-49a1-a452-a0922e92842b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/ips" status: 200 len: 145 microversion: 2.1 time: 0.043851 Jul 01 19:43:01.486764 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 299/590] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:43:01 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:02.381196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:02.382174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=75 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:02.386853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:02.387843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:02.396266 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:02.396717 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:02.397485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:02.397918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:02.423519 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a5b0d348-d821-417a-b178-fe66b125a69e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/ips" status: 200 len: 151 microversion: 2.1 time: 0.043882 Jul 01 19:43:02.424435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 292/591] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:43:02 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:04.643066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:04.643577 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:04.649729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:04.650207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:04.650971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:04.651397 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:04.654375 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "438480ec-2306-4605-ba85-4b8314088f5c"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:04.655420 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:04.662434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:04.662833 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:04.663537 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:04.663963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:04.675495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b9c5802f-3534-46aa-8741-5183ea5616de tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/ips" status: 200 len: 151 microversion: 2.20 time: 0.036559 Jul 01 19:43:04.676061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 300/592] 10.222.0.61 () {60 vars in 1288 bytes} [Fri Jul 1 19:43:04 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:43:04.862551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a894dc5a-2c29-4198-bb67-f84781566167"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:04.864327 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:04.871917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:04.872678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:04.873826 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:04.874556 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:04.985819 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d101765-a848-444d-a640-40cbc18d13c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335243 Jul 01 19:43:04.991602 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 293/593] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:43:04 2022] POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:05.220858 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-995b1046-7f00-465d-a0e7-f2a13c3e1825 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362314 Jul 01 19:43:05.221475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 301/594] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:43:04 2022] POST /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:43:07.622556 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:07.623098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:07.629619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:07.630109 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:07.630864 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:07.631289 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:07.653848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lazy-loading 'flavor' on Instance uuid fc929a10-068e-444f-bc59-ab78f9821237 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:43:07.954543 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dc60287f-a13c-4055-922d-3da9aabaf7ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/action" status: 202 len: 0 microversion: 2.20 time: 0.337436 Jul 01 19:43:07.958690 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 294/595] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jul 1 19:43:07 2022] POST /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:43:07.966580 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:07.967660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:07.976247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:07.976957 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:07.978233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:07.979026 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:08.119856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:08.128379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:08.129811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:08.131116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b588a37-28c8-48ad-812f-2b581632a5bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.170711 Jul 01 19:43:08.131638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 302/596] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:07 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:09.151256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:09.151981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:09.158552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:09.158998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:09.159754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:09.160197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:09.293290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:09.301296 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:09.302814 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:09.303978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e56a4985-e96c-41e0-a218-3a36c91303b1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.157475 Jul 01 19:43:09.304529 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 295/597] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:09 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:10.325791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:10.326789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:10.333475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:10.333844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:10.334812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:10.335787 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:10.472229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:10.480346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:10.481848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:10.483039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-378245e5-c046-49f3-a237-1dd65e07a515 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.161587 Jul 01 19:43:10.483599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 303/598] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:10 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:43:11.501245 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:11.502066 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:11.508973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:11.509415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:11.510219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:11.510657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:11.648187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:11.656318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:11.657811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:11.658995 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9c73fa2a-58c9-4b3d-82d7-217792c1a6d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.161843 Jul 01 19:43:11.659545 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 296/599] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:11 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:12.682453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:12.682453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:12.686002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:12.686510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:12.687388 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:12.687861 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:12.830699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:12.840888 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:12.842408 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:12.843586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f6d7e2ae-5707-461d-8bc9-cc477e00cb8d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.170073 Jul 01 19:43:12.844147 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 304/600] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:12 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:43:13.862854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:13.863460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:13.870194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:13.870659 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:13.871595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:13.872032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:14.002326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:14.010196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:14.011669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:14.012897 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8c864f1c-437f-4333-9d65-14411ff4c214 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.154667 Jul 01 19:43:14.013436 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 297/601] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:13 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:14.657370 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d7177f65-2338-4325-a641-0c85a19b4d13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:14.664937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d7177f65-2338-4325-a641-0c85a19b4d13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:14.665402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d7177f65-2338-4325-a641-0c85a19b4d13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:14.731679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d7177f65-2338-4325-a641-0c85a19b4d13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Going to try to stop instance {{(pid=124350) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 19:43:14.778111 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d7177f65-2338-4325-a641-0c85a19b4d13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action" status: 202 len: 0 microversion: 2.1 time: 0.124623 Jul 01 19:43:14.781887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 305/602] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:43:14 2022] POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:43:14.788234 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:14.789119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:14.795931 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:14.796372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:14.797315 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:14.797743 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:14.929738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:14.938055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-608fa7a8-2f80-49dd-bc95-9ef44c580f08 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.153917 Jul 01 19:43:14.938620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 298/603] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:14 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:43:15.031967 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:15.032773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:15.039449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:15.039985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:15.040734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:15.041161 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:15.174611 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:15.186539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:15.188018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:15.189179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-defc14f3-2a73-4885-8158-8aa1306ddee9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.161709 Jul 01 19:43:15.189744 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 306/604] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:15 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:15.960301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:15.961169 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:15.969453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:15.969895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:15.970666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:15.971088 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:16.115273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:16.124624 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c98ab664-6184-4f44-aa4a-73233898925b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.170965 Jul 01 19:43:16.125717 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 299/605] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:15 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:16.212447 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:16.213410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:16.225029 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:16.225768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:16.227068 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:16.227789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:16.363129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:16.371556 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:16.373037 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:16.374228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e404d78-f651-4924-a59a-6ee5bc4faccc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.168394 Jul 01 19:43:16.374794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 307/606] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:16 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:17.146803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:17.147754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:17.158788 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:17.159534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:17.160843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:17.161565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:17.307843 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:17.316715 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d6788931-df2d-425c-a8ad-d08fd9b93fe2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.176324 Jul 01 19:43:17.317254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 300/607] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:17 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:17.392522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:17.393090 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:17.401157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:17.401801 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:17.403120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:17.403830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:17.549529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:17.559742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:17.561224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:17.562415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-362fe59a-ff07-476a-b7a0-21d542fbdfdb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.173968 Jul 01 19:43:17.562987 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 308/608] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:17 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:18.337223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:18.337846 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:18.346983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:18.347444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:18.348222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:18.348672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:18.588964 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:18.589634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:18.596558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:18.597008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:18.597779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:18.598254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:18.683233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:18.692820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2461ce5b-219c-4ccd-a01f-7b4155ade783 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.361503 Jul 01 19:43:18.693439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 301/609] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:18 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:18.753267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:18.765762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:18.767976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:18.769792 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-33c0ddb3-2ff5-4d92-8e32-612ccebe0d2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.184618 Jul 01 19:43:18.770716 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 309/610] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:18 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:43:19.715499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:19.717465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:19.724310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:19.724764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:19.725530 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:19.725978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:19.792933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:19.793518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:19.800110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:19.800553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:19.801312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:19.801773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:19.885447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:19.894059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ee83713c-8b12-40b0-9280-80b948e33f82 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.186027 Jul 01 19:43:19.894615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 302/611] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:19 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:19.945579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:19.954225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:19.955706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:19.956866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2f80362-605a-40f5-906d-ce55e9500593 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.168004 Jul 01 19:43:19.957431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 310/612] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:19 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:20.915570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:20.916501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:20.924440 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:20.924892 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:20.925661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:20.926128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:20.975712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:20.976979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:20.985063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:20.985487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:20.986329 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:20.986762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:21.081816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:21.090195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e6ca2e60-fc4f-4bb6-a5b2-5661524d6b13 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.180983 Jul 01 19:43:21.090856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 303/613] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:20 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:21.185693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:21.193571 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:21.195085 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:21.196238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2255e223-13d3-43a2-857f-81ace4d8d3a1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.224635 Jul 01 19:43:21.196830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 311/614] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:20 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:22.109158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:22.109793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:22.117260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:22.117714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:22.118570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:22.119022 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:22.215805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:22.216840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:22.224935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:22.225486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:22.226250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:22.226693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:22.258837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:22.267122 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-11c4b3b6-8fad-48f1-bff5-ec631dbabedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.162577 Jul 01 19:43:22.267904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 304/615] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:22 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:22.303889 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-afb491cf-ff4f-4e55-96b0-ab9e269d0a0a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: .version_select at 0x7f4764936700>, body: {"keypair": {"name": "tempest-keypair-543623714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF1NlUZXes14i50nSU5Q2Wiix2SvvEgDmZtQ8Wkf5Z0xIOL7BX4GRbYDLBn/y5qq0vaP9rvTuda+iVmHy28PF4wWk8J7XhBGxQxy7sdAWYKYiZOzuFBMoaaeC5ecBeB3w=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:22.317503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-afb491cf-ff4f-4e55-96b0-ab9e269d0a0a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:43:22.321381 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-afb491cf-ff4f-4e55-96b0-ab9e269d0a0a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:43:22.346431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-afb491cf-ff4f-4e55-96b0-ab9e269d0a0a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046299 Jul 01 19:43:22.347030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 305/616] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:43:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:43:22.369288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:22.377634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:22.379200 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:22.380380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3117077e-03be-4481-9552-308652d1f68c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.168859 Jul 01 19:43:22.380946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 312/617] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:22 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:23.285498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:23.286259 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:23.292678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:23.293372 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:23.294282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:23.294741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:23.314455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:23.399730 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:23.400412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:23.407251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:23.407698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:23.408459 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:23.408892 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:23.571933 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:23.580816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d673d48a-13cd-4553-8a72-41b868e814af tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.299789 Jul 01 19:43:23.581379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 306/618] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:23 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:23.663607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:23.668240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:23.673851 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:23.675372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:23.676543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0ca18ab9-23b1-48e8-8ff5-7c1015959a25 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.280985 Jul 01 19:43:23.678238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 313/619] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:23 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:23.739584 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2064210379", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bede229f-3edc-4006-b398-af17b8fdb00e"}], "security_groups": [{"name": "tempest-securitygroup--1796709083"}], "key_name": "tempest-keypair-543623714", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:23.890595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] validate_networks() for [('bede229f-3edc-4006-b398-af17b8fdb00e', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:43:24.598675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:24.599251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:24.607451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:24.607890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:24.608671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:24.609099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:24.777779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:43:24.778312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:43:24.778769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:43:24.779171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:43:24.779570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:43:24.790140 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:24.790805 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:24.791725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:24.792158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:24.811213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:43:24.815423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:43:24.827714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:43:24.830031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:43:24.843116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:24.851409 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9ac819a6-6116-4a58-9152-6fb8408114a3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.256734 Jul 01 19:43:24.851927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 314/620] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:24 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:24.856451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:24.857053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:24.863142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:24.863586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:24.864358 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:24.864791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:24.881444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-913ff02e-1eef-4524-b960-274ef7f90531 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.146108 Jul 01 19:43:24.882769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 307/621] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:43:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:43:24.892986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cc34de17-0bb7-4c63-af3b-983518561d92 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:24.894079 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cc34de17-0bb7-4c63-af3b-983518561d92 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:24.981870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cc34de17-0bb7-4c63-af3b-983518561d92 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:24.989578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cc34de17-0bb7-4c63-af3b-983518561d92 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1241 microversion: 2.1 time: 0.100864 Jul 01 19:43:24.990207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 308/622] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:24 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:25.049179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:25.057630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:25.059675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:25.060846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5acdd9df-8811-45d1-9d74-2112dac581cd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.208026 Jul 01 19:43:25.061402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 315/623] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:24 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:25.873317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:25.874222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:25.885782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:25.886542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:25.887895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:25.888338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:26.007057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:26.007644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:26.014726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:26.015112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:26.015919 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:26.016354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:26.023634 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:26.031917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9b43b243-da90-4e82-b60e-7b0ce8185350 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.165820 Jul 01 19:43:26.032479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 309/624] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:25 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:26.079399 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:26.080492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:26.086756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:26.087205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:26.087657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:26.088421 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:26.088834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:26.095242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fa197de9-0f2b-46a0-8e88-733de3759a07 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1293 microversion: 2.1 time: 0.091959 Jul 01 19:43:26.095869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 316/625] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:26 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:26.306123 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:26.314167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:26.315668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:26.317263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3b9175ea-0024-44c4-90d5-43327b71d57f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.241341 Jul 01 19:43:26.328500 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 310/626] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:26 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:43:27.058190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:27.060593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:27.070092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.070698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.071493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.071930 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.112730 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:27.113447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:27.120380 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.120829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.121601 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.122134 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.370524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:27.379100 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bd62cc5c-78ed-447f-b778-b663c7485c7e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.326322 Jul 01 19:43:27.379682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 317/627] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:27 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:27.384317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:27.384922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:27.391164 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.391612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.392379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.392811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.415291 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:27.424983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1b990f2c-5b18-42ac-840c-c5320fb79034 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.315329 Jul 01 19:43:27.426126 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 311/628] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:27 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:27.591551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:27.599735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:27.601276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:27.602462 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6fb1aece-5d06-40fe-bd30-b25cee0f94fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.221873 Jul 01 19:43:27.602994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 318/629] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:27 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:27.822677 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-f0f8fc77-2906-4b25-8927-7d4c45fae521 req-3ab489ae-0229-44cb-afb3-c1b45729a458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207060e8-4e36-4563-8fb9-54b21a39db6a", "tag": "144feb40-f020-42da-b3cf-2d3d806cb139"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:27.831665 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f0f8fc77-2906-4b25-8927-7d4c45fae521 req-3ab489ae-0229-44cb-afb3-c1b45729a458 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:27.832207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f0f8fc77-2906-4b25-8927-7d4c45fae521 req-3ab489ae-0229-44cb-afb3-c1b45729a458 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:27.844974 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-f0f8fc77-2906-4b25-8927-7d4c45fae521 req-3ab489ae-0229-44cb-afb3-c1b45729a458 service nova] Creating event network-changed:144feb40-f020-42da-b3cf-2d3d806cb139 for instance 207060e8-4e36-4563-8fb9-54b21a39db6a on hv-cinder-83124 Jul 01 19:43:27.851136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-f0f8fc77-2906-4b25-8927-7d4c45fae521 req-3ab489ae-0229-44cb-afb3-c1b45729a458 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033747 Jul 01 19:43:27.851818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 312/630] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:43:28.397035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:28.398305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:28.406629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.407078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.407836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.408291 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.504470 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:28.505174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:28.512015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.512479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.513364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.513872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.622868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:28.631584 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a06f1ef5-c6b4-4855-8388-842ed58b5d9a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.238733 Jul 01 19:43:28.632142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 319/631] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:28 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:28.645790 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-566bc03e-d749-449d-adb8-3a1d1459d349 req-25994670-7e2a-433b-b32a-016ee0dc9d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "name": "network-vif-plugged", "status": "completed", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:28.654025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-566bc03e-d749-449d-adb8-3a1d1459d349 req-25994670-7e2a-433b-b32a-016ee0dc9d9d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.654468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-566bc03e-d749-449d-adb8-3a1d1459d349 req-25994670-7e2a-433b-b32a-016ee0dc9d9d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.665914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-566bc03e-d749-449d-adb8-3a1d1459d349 req-25994670-7e2a-433b-b32a-016ee0dc9d9d service nova] Creating event network-vif-plugged:7ff227c5-7dfc-4476-b094-d71e27fb265f for instance fc929a10-068e-444f-bc59-ab78f9821237 on hv-cinder-83124 Jul 01 19:43:28.671172 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-566bc03e-d749-449d-adb8-3a1d1459d349 req-25994670-7e2a-433b-b32a-016ee0dc9d9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028864 Jul 01 19:43:28.671868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 320/632] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:28.677112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:28.677786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:28.684350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.684980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.685771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:28.686229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:28.766303 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:28.774091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-78cd2382-b8b0-4a78-8cd0-17f3136f5350 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.334292 Jul 01 19:43:28.774671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 313/633] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:28 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:28.904896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:28.913366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:28.915008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:28.916177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bab156bd-695e-4ad2-8463-0a2542b37c6b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.243229 Jul 01 19:43:28.916953 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 321/634] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:28 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:29.761516 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:29.762162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:29.768338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:29.768785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:29.769541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:29.769978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:29.791240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:29.791848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:29.798519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:29.798968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:29.799728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:29.800159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:29.971349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:29.975418 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:29.979716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d52d0bcf-ebc9-4af5-ae1b-c7712f6b9146 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.333448 Jul 01 19:43:29.980305 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 314/635] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:29 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:29.983368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-04dc0c01-3eff-4662-aabb-3a950248a58a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.195947 Jul 01 19:43:29.984285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 322/636] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:29 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:29.985080 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:29.985669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:29.992260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:29.992695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:29.993449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:29.993936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:30.124479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:30.132595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:30.134124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:30.135295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7d27c783-4ea1-4f58-91c0-1c319e20c72f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.153911 Jul 01 19:43:30.135859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 315/637] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:29 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:31.000226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:31.000889 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:31.001316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:31.001868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:31.008099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:31.008582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:31.009347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:31.009661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:31.009815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:31.010512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:31.011965 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:31.012743 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:31.207523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:31.210511 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:31.215855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-71713a75-5c9a-4e18-b2e7-af69b53c90be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.221071 Jul 01 19:43:31.216443 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 323/638] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:30 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:31.218455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-af3e4b24-8aed-4a6f-ad26-c107987ed53f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.221785 Jul 01 19:43:31.227754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 316/639] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:30 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:31.227917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:31.227917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:31.227917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:31.227917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:31.228675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:31.229332 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:31.361874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:31.370503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:31.371989 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:31.373147 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f75e720-cacc-4c26-bbdd-2e6bd9a1bce7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.155784 Jul 01 19:43:31.373712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 324/640] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:31 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:32.234897 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:32.235564 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:32.236558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:32.237179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:32.239659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=53 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:32.242172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:32.242612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:32.243394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:32.243892 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:32.245252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:32.245690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:32.246520 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:32.246989 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:32.438432 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:32.441682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:32.446800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fdcab862-c7f1-4e10-90f6-3693401dbe81 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.216526 Jul 01 19:43:32.447738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 317/641] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:32 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:32.450170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e4a18668-5ada-4b72-86dc-006d0c07797b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.217436 Jul 01 19:43:32.450980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 325/642] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:32 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:32.452461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:32.453060 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:32.454915 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:32.459653 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:32.460093 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:32.460857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:32.461271 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:32.607798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:32.617779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:32.620161 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:32.622021 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be8e4c00-ab1a-466e-9059-a824d2382fb6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.173084 Jul 01 19:43:32.622810 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 318/643] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:32 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:33.471023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:33.471976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:33.472127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:33.473046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:33.482908 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:33.483097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:33.483344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:33.483536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:33.484138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:33.484281 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:33.484568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:33.484720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:33.673866 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:33.676783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:33.682839 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3e78b64b-532d-40a7-8d1a-4758f83bd6c3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1724 microversion: 2.1 time: 0.216779 Jul 01 19:43:33.683708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 319/644] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:33 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:33.685192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dc702fcb-bd97-4c1d-9128-148ccadd4fa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.221167 Jul 01 19:43:33.685770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 326/645] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:33 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:33.689009 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:33.689533 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:33.696240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:33.696689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:33.697811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:33.698279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:33.835817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:33.843870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:33.845355 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:33.846557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-91a20ae8-24a4-46a4-9571-6d9134c0eb2e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.161952 Jul 01 19:43:33.847120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 320/646] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:33 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:34.705914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:34.706859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:34.707502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:34.707670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:34.717507 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.718001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.718767 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.719083 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.719238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.719538 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.720305 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.720739 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.799829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:34.912453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:34.915804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:34.920948 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b6dddae-0cdf-467a-b07e-610dec3cd471 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1701 microversion: 2.1 time: 0.221521 Jul 01 19:43:34.921608 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 327/647] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:34 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1701 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:34.923753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-957288d2-42ae-4022-9ec9-deefab726bc4 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.224141 Jul 01 19:43:34.924317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 321/648] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:34 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:34.926838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:34.927595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:34.933813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.934234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.935318 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.935746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.938164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-42bcef97-b884-4404-a645-ddc86909c120 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:34.944371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42bcef97-b884-4404-a645-ddc86909c120 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:34.944816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42bcef97-b884-4404-a645-ddc86909c120 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:34.993117 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=12 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:35.008623 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-42bcef97-b884-4404-a645-ddc86909c120 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Going to try to start instance {{(pid=124349) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 19:43:35.070032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-42bcef97-b884-4404-a645-ddc86909c120 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action" status: 202 len: 0 microversion: 2.1 time: 0.135270 Jul 01 19:43:35.071505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 322/649] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:43:34 2022] POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:43:35.073915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:35.080025 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:35.080724 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:35.083697 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:35.085592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:35.087011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f10ec2ac-609c-4082-983d-1fea5395d1df tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1741 microversion: 2.20 time: 0.164247 Jul 01 19:43:35.087618 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 328/650] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:34 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:35.088187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:35.088674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:35.089437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:35.089902 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:35.223233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:35.231465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a143dcc6-80f7-49b9-a888-8abe60f1d54e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1710 microversion: 2.1 time: 0.155715 Jul 01 19:43:35.232207 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 323/651] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:35 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:43:35.941599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:35.942315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:35.949239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:35.949982 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:35.951218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:35.951949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:36.105815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:36.106453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:36.113816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:36.115149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:36.117067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:36.117668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:36.131005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:36.158971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:36.163717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62892113-a47b-47c5-913e-14e563caac36 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.226747 Jul 01 19:43:36.166360 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 329/652] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:35 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:36.257657 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:36.260390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:36.270865 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:36.271613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:36.272631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:36.273211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:36.290562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:36.301165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:36.303053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:36.304593 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bce360bc-7601-4cfc-b8ef-02eb82b71707 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.202583 Jul 01 19:43:36.318995 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 324/653] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:36 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:43:36.444450 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:36.452950 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-46b8273a-609c-41b0-9cb0-5d847f9c1f36 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1710 microversion: 2.1 time: 0.208168 Jul 01 19:43:36.453527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 330/654] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:36 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1710 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:43:36.784539 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-f2550c92-3968-4298-9777-1a3c4b943973 req-b2fbedb4-78c3-4571-843e-23e9cabf15b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207060e8-4e36-4563-8fb9-54b21a39db6a", "name": "network-vif-plugged", "status": "completed", "tag": "144feb40-f020-42da-b3cf-2d3d806cb139"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:36.796218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f2550c92-3968-4298-9777-1a3c4b943973 req-b2fbedb4-78c3-4571-843e-23e9cabf15b1 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:36.797240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f2550c92-3968-4298-9777-1a3c4b943973 req-b2fbedb4-78c3-4571-843e-23e9cabf15b1 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:36.813036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-f2550c92-3968-4298-9777-1a3c4b943973 req-b2fbedb4-78c3-4571-843e-23e9cabf15b1 service nova] Creating event network-vif-plugged:144feb40-f020-42da-b3cf-2d3d806cb139 for instance 207060e8-4e36-4563-8fb9-54b21a39db6a on hv-cinder-83124 Jul 01 19:43:36.818719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-f2550c92-3968-4298-9777-1a3c4b943973 req-b2fbedb4-78c3-4571-843e-23e9cabf15b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037988 Jul 01 19:43:36.819976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 325/655] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:37.181336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:37.181935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:37.189128 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:37.189569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:37.190365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:37.190795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:37.195110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:37.331147 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:37.331893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:37.348788 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:37.349563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:37.350394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:37.350820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:37.353457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:37.363133 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c524ff64-6165-45ba-9c11-79197d87b766 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.185694 Jul 01 19:43:37.364172 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 331/656] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:37 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:37.471128 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:37.472144 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:37.478851 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:37.479649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:37.480517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:37.481210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:37.509786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:37.520705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:37.522754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:37.524552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2fc4f30d-2703-4af1-abf8-584a5be1b9f3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.199270 Jul 01 19:43:37.526307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 326/657] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:37 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:43:37.666875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:37.676659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f72ede6d-127c-43a8-81fb-44592286fbcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1714 microversion: 2.1 time: 0.209711 Jul 01 19:43:37.689361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 332/658] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:37 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1714 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:43:38.380447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:38.381164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:38.388123 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:38.388848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:38.389769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:38.390409 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:38.535862 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:38.544737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:38.545559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:38.548267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d239096-2842-4fb4-a9c0-5c3f5d2e786f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.171643 Jul 01 19:43:38.552981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:38.553738 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:38.554825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:38.555482 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:38.558681 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 327/659] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:38 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:38.702634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:38.715160 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:38.716949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:38.718491 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ac6a851f-80bd-4b18-baaf-6f775c8096f8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.179269 Jul 01 19:43:38.719300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 333/660] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:38 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:39.568005 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:39.569383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:39.577138 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:39.577696 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:39.578598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:39.579156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:39.718237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:39.726602 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-78132216-5672-4ae5-8859-f89df42cd401 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1367 microversion: 2.1 time: 0.162810 Jul 01 19:43:39.727482 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 328/661] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:39 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:39.736599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:39.737235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:39.744499 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:39.744979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:39.745791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:39.746258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:39.885133 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:39.894623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:39.896192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:39.897366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a76d4e18-d9df-40f6-8974-731de7d46ff8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.164682 Jul 01 19:43:39.897935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 334/662] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:39 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:40.746899 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:40.748206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:40.755157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:40.755566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:40.756341 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:40.756774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:40.899019 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:40.906920 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bcc2c998-03c3-4d96-8d78-220409ef393d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1557 microversion: 2.1 time: 0.166304 Jul 01 19:43:40.907485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 329/663] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:43:40 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:43:40.916780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:40.917415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:40.923012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:40.923512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:40.924403 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:40.924845 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:40.925613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:40.926331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:40.929937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:40.930515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:40.931618 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:40.932172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:41.298664 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b0e4d7a1-1a60-487a-ba92-58400ca729c9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.379363 Jul 01 19:43:41.299164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 330/664] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:43:40 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/os-interface => generated 284 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:41.595778 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:41.604838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:41.606529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:41.607790 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c35ec9de-2fb9-477a-a9d2-1990300e87d6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.695089 Jul 01 19:43:41.608405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 335/665] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:40 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:42.339099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-1eaedee5-bc7e-4ad8-82a9-7c1ee9cc33ec req-3490232f-ea0a-420f-b70a-101687f3c2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207060e8-4e36-4563-8fb9-54b21a39db6a", "tag": "144feb40-f020-42da-b3cf-2d3d806cb139"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:42.347798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1eaedee5-bc7e-4ad8-82a9-7c1ee9cc33ec req-3490232f-ea0a-420f-b70a-101687f3c2b7 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:42.348564 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1eaedee5-bc7e-4ad8-82a9-7c1ee9cc33ec req-3490232f-ea0a-420f-b70a-101687f3c2b7 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:42.366848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-1eaedee5-bc7e-4ad8-82a9-7c1ee9cc33ec req-3490232f-ea0a-420f-b70a-101687f3c2b7 service nova] Creating event network-changed:144feb40-f020-42da-b3cf-2d3d806cb139 for instance 207060e8-4e36-4563-8fb9-54b21a39db6a on hv-cinder-83124 Jul 01 19:43:42.373347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-1eaedee5-bc7e-4ad8-82a9-7c1ee9cc33ec req-3490232f-ea0a-420f-b70a-101687f3c2b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038889 Jul 01 19:43:42.374417 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 331/666] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:43:42.626265 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:42.627602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:42.641896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:42.642793 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:42.643849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:42.644489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:42.940033 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:42.950645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:42.952680 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:42.954176 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85974a2d-50cd-4b9a-ac9b-cbb093ef0d19 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.331927 Jul 01 19:43:42.954753 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 336/667] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:42 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:43.973649 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:43.974290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:43.981528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:43.981992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:43.983013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:43.983446 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:44.127051 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:44.135342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:44.136871 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:44.138048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-74625e58-c25d-414f-8944-988a3f793859 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.168990 Jul 01 19:43:44.138655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 332/668] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:43 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:45.157079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:45.158327 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:45.169027 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:45.169825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:45.172238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:45.173035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:45.340283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:45.349183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:45.351781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:45.352098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1daa70a8-30ab-4bcf-83e1-674153ee3269 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.199503 Jul 01 19:43:45.363250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 337/669] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:45 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:46.372193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:46.372793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:46.380390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:46.380830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:46.381636 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:46.382094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:46.535098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:46.543074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:46.544543 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:46.545689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-45155e2c-d19f-4327-ad29-ac75ce843529 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.178306 Jul 01 19:43:46.546535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 333/670] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:46 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:47.573184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:47.574122 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:47.582738 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:47.583183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:47.583917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:47.584382 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:47.727696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:47.737777 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:47.740513 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:47.741696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4ff4422d-16d6-4352-8132-8c0430947245 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1736 microversion: 2.20 time: 0.175754 Jul 01 19:43:47.742290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 338/671] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:47 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:48.760871 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:48.761444 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:48.768727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:48.769173 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:48.769926 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:48.770395 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:48.990460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:48.999292 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:49.000877 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:49.002164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f6f25bb5-6464-48bf-9580-cc4598254291 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1718 microversion: 2.20 time: 0.245203 Jul 01 19:43:49.002715 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 334/672] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:48 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1718 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:50.026619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:50.027477 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:50.038535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:50.039276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:50.040526 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:50.041241 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:50.176856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:50.185171 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:50.186687 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:50.187837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7a7c2c47-c184-4ad6-9664-4503bf9243fc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1718 microversion: 2.20 time: 0.168020 Jul 01 19:43:50.188398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 339/673] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:50 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:51.206967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:51.207559 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:51.214232 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.214676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.215670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.216100 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.352449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:51.360807 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:51.362362 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:51.363500 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-601bf47d-d892-40a8-bf5f-a576dc5364d5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1721 microversion: 2.20 time: 0.160627 Jul 01 19:43:51.364071 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 335/674] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:51 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:51.390742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ef163ae-ef03-4f2d-b6e7-21bb8a4a57a7"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:51.392200 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:51.399866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.400445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.401562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.402213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.709675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-07074f07-6ee4-4369-933f-abff67a61786 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325333 Jul 01 19:43:51.710326 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 340/675] 10.222.0.61 () {62 vars in 1363 bytes} [Fri Jul 1 19:43:51 2022] POST /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:43:51.822830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:51.823492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:51.829775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.830263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.831116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.831485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.980900 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bd324f9f-fe14-4821-b036-316a6d02e0a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/action" status: 202 len: 0 microversion: 2.20 time: 0.162273 Jul 01 19:43:51.981472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 336/676] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jul 1 19:43:51 2022] POST /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:43:51.990072 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:51.990680 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:51.997262 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.997706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:51.998508 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:51.998941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:52.136635 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:52.145066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:52.146693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:52.147852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8530fc0b-361d-4eae-8799-2578cc1de861 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1747 microversion: 2.20 time: 0.161784 Jul 01 19:43:52.148419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 341/677] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:51 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:52.797827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-9ecd4bcf-8099-4826-92dd-88a9a7a36588 req-4d633d2a-65b9-4b0c-8dd8-3a30e3afaa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "name": "network-vif-unplugged", "status": "completed", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:43:52.807236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-9ecd4bcf-8099-4826-92dd-88a9a7a36588 req-4d633d2a-65b9-4b0c-8dd8-3a30e3afaa72 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:52.807890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-9ecd4bcf-8099-4826-92dd-88a9a7a36588 req-4d633d2a-65b9-4b0c-8dd8-3a30e3afaa72 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:52.820833 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.compute.server_external_events [req-9ecd4bcf-8099-4826-92dd-88a9a7a36588 req-4d633d2a-65b9-4b0c-8dd8-3a30e3afaa72 service nova] Unable to find a host for instance fc929a10-068e-444f-bc59-ab78f9821237. Dropping event network-vif-unplugged {{(pid=124349) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 19:43:52.821901 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-9ecd4bcf-8099-4826-92dd-88a9a7a36588 req-4d633d2a-65b9-4b0c-8dd8-3a30e3afaa72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029305 Jul 01 19:43:52.823204 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 337/678] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 19:43:53.166691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:53.167305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:53.174092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:53.174554 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:53.175325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:53.175756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:53.313231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:53.321859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:53.323760 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:53.324934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4ee8dfc1-7631-4d47-879d-4091ead63069 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1749 microversion: 2.20 time: 0.162693 Jul 01 19:43:53.325551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 342/679] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:53 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:54.343909 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:54.344471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:54.351150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:54.351599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:54.352352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:54.352782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:54.494760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:54.503763 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:54.505300 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:54.506519 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-556a5913-e1da-4d9c-9d12-cefad93d8b30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.166704 Jul 01 19:43:54.507077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 338/680] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:54 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:55.526506 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:55.527202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:55.536132 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:55.536582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:55.537345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:55.537809 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:55.666515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:55.675311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:55.676865 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:55.677973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3aee556e-d310-4a1d-9245-39f699ad83f0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.156913 Jul 01 19:43:55.678562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 343/681] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:55 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:56.700026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:56.700796 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:56.708073 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:56.708612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:56.709370 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:56.709818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:56.843718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:56.853665 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:56.855244 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:56.856418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c741884f-cc88-4c6a-9a09-8b6b23a510bd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.163002 Jul 01 19:43:56.857191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 339/682] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:56 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:57.874156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:57.874760 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:57.881636 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:57.882155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:57.883026 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:57.883465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:58.024360 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:58.033099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:58.034648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:58.035897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-03ec37ff-7081-42e4-a436-03172b223228 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.165659 Jul 01 19:43:58.036373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 344/683] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:57 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:43:59.056556 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:43:59.057993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:43:59.067399 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:59.067826 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:59.068643 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:43:59.069077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:43:59.209580 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:59.218263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:59.219754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:43:59.220918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ddae28a1-5f05-4d6a-9048-1d7fcd233150 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.169144 Jul 01 19:43:59.221557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 340/684] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:43:59 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:00.245811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:00.247117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:00.261097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:00.261492 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:00.262344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:00.262784 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:00.268429 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:00.406758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:00.415818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:00.417344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:00.418643 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c623ed48-b78e-47b1-b67a-2bd6c5f5fa65 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.176842 Jul 01 19:44:00.419237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 345/685] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:00 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:01.437111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:01.437754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:01.445025 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:01.445477 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:01.446351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:01.446774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:01.582657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:01.591750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:01.593269 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:01.594496 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5b07dcb0-075b-4361-be5c-d0753d99a224 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.161542 Jul 01 19:44:01.595283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 341/686] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:01 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:02.613276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:02.613902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:02.616288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=42 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:02.621994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:02.622578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:02.623354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:02.623791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:02.762274 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:02.770863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:02.772569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:02.773815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9d522712-d35b-472a-873b-62af79d7ad81 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.164570 Jul 01 19:44:02.774634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 346/687] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:02 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:03.793128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:03.793742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:03.796241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=50 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:03.801647 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:03.802139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:03.802906 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:03.803334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:03.823797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:03.940718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:03.950078 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:03.951609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:03.952776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-47ee2c4a-304a-415d-a404-27b7dd83caa3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.163749 Jul 01 19:44:03.953344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 342/688] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:03 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:04.971391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:04.972789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:04.979603 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:04.980147 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:04.980908 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:04.981339 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:05.125013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:05.133817 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:05.135335 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:05.136541 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f71a5dcd-505c-4269-9e77-6d39aafdddf3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.169086 Jul 01 19:44:05.137112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 347/689] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:04 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:06.155136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:06.155783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:06.162907 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:06.163457 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:06.164195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:06.164525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:06.304849 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:06.313640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:06.315183 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:06.316362 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e57f552b-0766-46fa-9096-12d006382958 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.165251 Jul 01 19:44:06.316927 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 343/690] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:06 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:07.335312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:07.335922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:07.343440 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:07.344077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:07.344938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:07.345373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:07.490391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:07.498948 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:07.500431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:07.501598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b84cc6d3-56e4-4ef5-b879-9cd7b6524b33 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.170438 Jul 01 19:44:07.502402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 348/691] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:07 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:08.524536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:08.525478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:08.536057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:08.536792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:08.538111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:08.538835 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:08.682468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:08.691774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:08.693263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:08.694473 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0f3b5570-2633-475e-8b0d-c6fcfad4f5a5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.176849 Jul 01 19:44:08.695005 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 344/692] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:08 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:09.716907 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:09.717930 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:09.728869 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:09.729582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:09.730969 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:09.731689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:09.871824 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:09.885850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:09.888350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:09.890401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e1dc4e89-df51-4103-a861-5fd785625273 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.179682 Jul 01 19:44:09.891355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 349/693] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:09 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:10.910583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:10.911138 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:10.918166 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:10.918616 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:10.919371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:10.919798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:11.058065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:11.067028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:11.068574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:11.069748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eefc58d1-f3c2-4e21-b739-78044c4083dc tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.163177 Jul 01 19:44:11.070343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 345/694] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:10 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:12.088567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:12.089187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:12.096146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:12.096593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:12.097358 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:12.097795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:12.239044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:12.247842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:12.249311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:12.250504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ad2c3d85-4f94-4d53-bb9f-18eb09b92378 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.165967 Jul 01 19:44:12.251061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 350/695] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:12 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:13.268686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:13.269316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:13.276657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:13.277057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:13.277861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:13.278356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:13.413165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:13.421816 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:13.423353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:13.424523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-baddf60f-8e97-4e9a-9871-e657e384aba6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.160033 Jul 01 19:44:13.425057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 346/696] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:13 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:14.446707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:14.447646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:14.454686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:14.455128 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:14.455922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:14.456352 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:14.600699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:14.609820 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:14.611349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:14.612516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0b2ac973-3edc-40c9-a125-2ef753a52a15 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.171338 Jul 01 19:44:14.613084 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 351/697] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:14 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:15.631860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:15.632600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:15.640409 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:15.640912 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:15.641762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:15.642284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:15.782646 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:15.796318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:15.798783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:15.800571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5f6b5b67-129c-4fee-b527-604c1a20fba2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.172810 Jul 01 19:44:15.801391 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 347/698] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:15 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:16.342207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1681ada2-f95a-4909-ae02-90049613ec61"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:16.343327 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:16.350227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.350673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.351426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.351838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.644819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-78b448f6-56ec-4147-875b-97dc51f0b4c0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428699 Jul 01 19:44:16.645433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 352/699] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:44:16 2022] POST /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:44:16.821115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:16.821682 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:16.829353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.829793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.830597 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.831020 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.974909 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:16.984762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:16.986271 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:16.987435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-afd11373-7159-4297-9730-31e5ea66dbba tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.170589 Jul 01 19:44:16.987989 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 348/700] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:16 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:18.011316 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:18.012287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:18.022904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:18.023646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:18.024640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:18.025075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:18.154628 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:18.163577 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:18.165096 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:18.166278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8062920f-0aab-4638-9a96-32a3b59b4002 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.163651 Jul 01 19:44:18.166798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 353/701] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:18 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:19.189173 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:19.189785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:19.198360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:19.198808 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:19.199583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:19.200018 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:19.350817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:19.362312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:19.365350 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:19.367397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-77d1bf36-8885-40ac-941f-04efee4c7356 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.185224 Jul 01 19:44:19.368574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 349/702] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:19 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:20.390159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:20.390922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:20.399963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:20.400555 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:20.401562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:20.402199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:20.543056 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:20.554867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:20.556363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:20.557562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f034c8a7-aef0-4e06-83b2-5e6b225aa44e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.173492 Jul 01 19:44:20.558105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 354/703] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:20 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:21.578614 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:21.579231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:21.586224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:21.586685 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:21.587445 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:21.587878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:21.721884 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:21.731022 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:21.733411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:21.735278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9f62a928-9c4a-414a-be30-d19496afac3f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.160399 Jul 01 19:44:21.736108 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 350/704] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:21 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:22.759084 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:22.759917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:22.767312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:22.767756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:22.768525 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:22.768959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:22.900372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:22.909508 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:22.911036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:22.912282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-56984884-d332-445a-8fe9-2b7f8495448f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.158536 Jul 01 19:44:22.912766 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 355/705] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:22 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:23.068186 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-9eea4440-2deb-4f98-9b2a-945a207344c5 req-7a904030-4086-4440-a770-af74e3ff8709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "name": "network-vif-plugged", "status": "completed", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:23.077121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-9eea4440-2deb-4f98-9b2a-945a207344c5 req-7a904030-4086-4440-a770-af74e3ff8709 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:23.077646 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-9eea4440-2deb-4f98-9b2a-945a207344c5 req-7a904030-4086-4440-a770-af74e3ff8709 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:23.089130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-9eea4440-2deb-4f98-9b2a-945a207344c5 req-7a904030-4086-4440-a770-af74e3ff8709 service nova] Creating event network-vif-plugged:7ff227c5-7dfc-4476-b094-d71e27fb265f for instance fc929a10-068e-444f-bc59-ab78f9821237 on hv-cinder-83124 Jul 01 19:44:23.094150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-9eea4440-2deb-4f98-9b2a-945a207344c5 req-7a904030-4086-4440-a770-af74e3ff8709 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029706 Jul 01 19:44:23.094748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 351/706] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:44:23.934812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:23.935451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:23.943158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:23.943619 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:23.944417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:23.944866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:24.092092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:24.100485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:24.102083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:24.103263 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec642f0b-6253-4668-87b4-15484d1f311f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.174953 Jul 01 19:44:24.103810 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 356/707] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:23 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:25.126166 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:25.127313 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:25.138004 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:25.138774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:25.139551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:25.139987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:25.234149 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:25.235175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:25.241842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:25.242322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:25.243095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:25.243531 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:25.266902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lazy-loading 'flavor' on Instance uuid 107094b7-ca95-4b66-b984-2359f2ef2a51 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:44:25.271248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:25.280005 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:25.281545 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:25.282683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1acf7ff9-7794-48f9-af5b-d7496d326e36 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.164508 Jul 01 19:44:25.283408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 352/708] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:25 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:25.404726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2dcdd8c9-2922-414f-a9a2-402764b1558a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/action" status: 200 len: 32 microversion: 2.1 time: 0.174499 Jul 01 19:44:25.405376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 357/709] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:44:25 2022] POST /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 19:44:25.419116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:25.420008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:25.429200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:25.429855 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:25.431072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:25.431720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:25.566611 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:25.575237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be8fb1c6-f9a2-48b2-88ed-553905dd4b7b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.162288 Jul 01 19:44:25.575798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 353/710] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:25 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:26.311138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:26.311806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:26.318226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:26.318670 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:26.319435 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:26.319866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:26.344245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:26.534506 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:26.546546 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:26.549555 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:26.551073 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e4a9be8d-99f5-4a97-9a1a-1086dee59e30 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.244850 Jul 01 19:44:26.552118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 358/711] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:26 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:26.593151 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:26.594719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:26.601118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:26.601567 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:26.602364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:26.602797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:26.740061 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:26.748461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-42b457a3-533a-4f22-a131-d9ccd71fdb4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.159423 Jul 01 19:44:26.749031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 354/712] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:26 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:27.568712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:27.569257 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:27.576845 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:27.577424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:27.578242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:27.578675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:27.722917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:27.731604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:27.733077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:27.734269 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-869c440c-2532-4ce4-958c-c6e81c091dc5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1805 microversion: 2.20 time: 0.169525 Jul 01 19:44:27.734828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 359/713] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:27 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:27.766054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:27.766775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:27.773400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:27.773846 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:27.774638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:27.775073 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:27.909174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:27.917301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a49e785e-e909-4002-9761-c891a9696a64 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.156086 Jul 01 19:44:27.917886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 355/714] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:27 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:28.757034 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:28.758038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:28.767254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:28.767708 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:28.768471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:28.768906 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:28.911614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:28.918916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:28.921386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:28.923130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-93ccd21d-f60f-4247-bc2f-4b27b75adaf0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1792 microversion: 2.20 time: 0.172526 Jul 01 19:44:28.923772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 360/715] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:44:28 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1792 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:44:28.939494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:28.940154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:28.950463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:28.951096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:28.952178 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:28.952794 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:29.098375 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:29.106980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9c686b8e-4720-4808-a5a3-3d87c8551b9a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.172356 Jul 01 19:44:29.107528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 356/716] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:28 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:30.128288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:30.129287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:30.139683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:30.140134 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:30.140884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:30.141317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:30.288716 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:30.299164 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8d56c32b-906c-4222-995b-dab5de7f3b21 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.177402 Jul 01 19:44:30.299760 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 361/717] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:30 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:31.317468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:31.318614 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:31.327053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:31.327414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:31.328196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:31.328632 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:31.475828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:31.484197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b60ac035-58c5-491d-9418-bcdc9c819a71 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.170860 Jul 01 19:44:31.484770 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 357/718] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:31 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:32.505669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:32.506629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:32.516380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:32.516830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:32.517596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:32.518062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:32.654684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:32.662803 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-178af46f-1c31-4379-a6c7-600512290743 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.163613 Jul 01 19:44:32.663377 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 362/719] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:32 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:33.681930 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:33.682763 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:33.690377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:33.690827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:33.691626 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:33.692068 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:33.828187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:33.836409 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d83284b4-a702-4f19-8e64-0e12c590a444 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.159365 Jul 01 19:44:33.836995 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 358/720] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:33 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:34.856670 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:34.857587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:34.860247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=34 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:34.866155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:34.866590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:34.867347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:34.867768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:35.003465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:35.011841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f3cba879-5515-4246-a715-805095fecfc1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.161639 Jul 01 19:44:35.012409 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 363/721] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:34 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:36.032914 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:36.033911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:36.037819 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=34 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:36.046481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:36.046927 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:36.047702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:36.048142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:36.050978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=95 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:36.175927 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:36.184545 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0df2d35f-dc29-49c8-a62a-c5497c99f2b1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.158282 Jul 01 19:44:36.185180 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 359/722] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:36 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:37.206448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:37.207416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:37.218700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:37.219150 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:37.219914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:37.220348 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:37.363975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:37.372416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3581deb1-1354-4ddb-894b-8f5d3f80866f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.172476 Jul 01 19:44:37.372987 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 364/723] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:37 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:38.394336 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:38.395349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:38.405904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:38.406706 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:38.407969 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:38.408750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:38.552466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:38.561046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dd960465-6b80-4097-b1f0-dac777dc9b68 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.173330 Jul 01 19:44:38.561594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 360/724] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:38 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:39.583080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:39.584027 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:39.594806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:39.595250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:39.596006 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:39.596440 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:39.743069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:39.756353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-15220721-3345-4810-ac13-9e79bfdc9aa0 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.179680 Jul 01 19:44:39.757266 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 365/725] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:39 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:40.777657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:40.778386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:40.784713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:40.785170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:40.785934 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:40.786396 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:40.924358 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:40.932531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b3a626ef-310a-4ea0-99ca-7d497687a44e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.159593 Jul 01 19:44:40.933139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 361/726] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:40 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:44:41.951470 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:41.952172 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:41.959669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:41.960114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:41.960883 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:41.961346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:42.095969 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:42.104292 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c4a69ec1-e2a4-470a-a504-0a61abc6b21f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.157763 Jul 01 19:44:42.104864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 366/727] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:41 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:43.125400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:43.126507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:43.133471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:43.133916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:43.134694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:43.135120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:43.274402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:43.282920 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5eb854ba-0fdc-4e2f-b71e-da62300182ac tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.164016 Jul 01 19:44:43.283526 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 362/728] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:43 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:44.304544 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:44.305483 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:44.316929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:44.317609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:44.318922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:44.319670 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:44.459995 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:44.473394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d15e1446-8bad-4452-b71d-f2e370196793 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.175188 Jul 01 19:44:44.474379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 367/729] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:44 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:45.496374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:45.496991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:45.504783 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:45.505237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:45.506039 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:45.506459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:45.695162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:45.704274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ee2c1bfb-cffe-4961-aa1e-72efd44a24ba tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.212058 Jul 01 19:44:45.704770 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 363/730] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:45 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:46.725985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:46.726957 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:46.737644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:46.738126 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:46.738901 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:46.739336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:46.871069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:46.879165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ffede523-d91b-4ec1-b15a-8b85b3ad8580 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.159564 Jul 01 19:44:46.879702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 368/731] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:46 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:47.900585 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:47.901600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:47.911115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:47.911566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:47.912327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:47.912765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:48.045136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:48.053689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-17a9ab33-ff09-40ac-a940-62774b6dabf8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1737 microversion: 2.1 time: 0.159661 Jul 01 19:44:48.054310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 364/732] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:47 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:49.070925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:49.071863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:49.078804 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.079250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.080011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.080443 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.231112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:49.244181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9e11f1c6-6c35-4ed5-9951-ca9363d8f888 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1717 microversion: 2.1 time: 0.176876 Jul 01 19:44:49.244948 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 369/733] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:49 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:49.300971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:49.301480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:49.308041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.308487 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.309273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.309704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.441442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] HTTP exception thrown: Cannot 'detach_volume' instance 107094b7-ca95-4b66-b984-2359f2ef2a51 while it is in vm_state rescued Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Request method failure captured: Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments/1681ada2-f95a-4909-ae02-90049613ec61 HTTP/1.1 Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv002nx8fsanozFIk_k9JzkgEqUOE9MB3q4Lv6Te5dr16vSvMXmyEulASNznKW0X1Yo2TxPfZZaeHYdqdGlmS9vxnvSitealY4CfvTbjF-k5_qO9rOhW0pPOMnYPmYoQsUkoPz01VhB_IirGGMzYdIOgTSTL5XXVIPhuRYZa6H8TmtnY Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:44:49.444101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd397adb95a6455b8e78db9b132d865e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: bf5ff69a857f412fb65dce1b59a22e9d Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:44:49.445475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Cannot 'detach_volume' instance 107094b7-ca95-4b66-b984-2359f2ef2a51 while it is in vm_state rescued Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'server_id': '107094b7-ca95-4b66-b984-2359f2ef2a51', 'id': '1681ada2-f95a-4909-ae02-90049613ec61'} Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:44:49.446193 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 107094b7-ca95-4b66-b984-2359f2ef2a51 while it is in vm_state rescued Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 107094b7-ca95-4b66-b984-2359f2ef2a51 while it is in vm_state rescued Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:44:49.447841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Returning 409 to user: Cannot 'detach_volume' instance 107094b7-ca95-4b66-b984-2359f2ef2a51 while it is in vm_state rescued {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:44:49.449083 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1e2f2fcc-b6ff-4d0e-8977-51abe615a7a8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments/1681ada2-f95a-4909-ae02-90049613ec61" status: 409 len: 152 microversion: 2.1 time: 0.148719 Jul 01 19:44:49.449083 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 365/734] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:44:49 2022] DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments/1681ada2-f95a-4909-ae02-90049613ec61 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 19:44:49.457075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:49.457604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:49.463805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.464243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.464994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.465421 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.541679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cf02a4a7-f49e-4865-abbe-20ac707c562d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "POST /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/action" status: 202 len: 0 microversion: 2.1 time: 0.089684 Jul 01 19:44:49.542430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 370/735] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:44:49 2022] POST /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:44:49.552716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:49.553236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:49.560360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.560855 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.561673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:49.562139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:49.783619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:49.792031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-55272b6a-ae1e-43e5-98ad-0d1bfc3aaaab tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1725 microversion: 2.1 time: 0.243858 Jul 01 19:44:49.792572 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 366/736] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:49 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:50.815876 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:50.816630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:50.823552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:50.824000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:50.824765 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:50.825200 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:50.966553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:50.974915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-66e7af0f-3ecf-4e13-b742-fe1f51f17e4b tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1725 microversion: 2.1 time: 0.166727 Jul 01 19:44:50.975496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 371/737] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:50 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:51.996755 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:51.997836 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:52.008800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:52.009531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:52.010829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:52.011536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:52.156089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:52.164437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-024ad411-a464-42f5-9f5b-87365449be11 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1725 microversion: 2.1 time: 0.174345 Jul 01 19:44:52.164979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 367/738] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:51 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:53.181916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:53.182565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:53.189474 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:53.189936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:53.190724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:53.191165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:53.326644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:53.335285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fc12ace9-36a2-4af8-a156-16c60043dffd tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1725 microversion: 2.1 time: 0.157303 Jul 01 19:44:53.335897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 372/739] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:53 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:54.356079 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:54.356924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:54.368055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:54.368798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:54.370149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:54.370875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:54.515041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:44:54.523663 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e4d81926-25c0-4684-8b77-0c77fd195355 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1731 microversion: 2.1 time: 0.174287 Jul 01 19:44:54.524246 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 368/740] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:44:54 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:44:54.540346 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:54.540896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:54.547478 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:54.547919 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:54.548671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:54.549099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:54.628134 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-65413731-39b5-4160-a631-7a9401b4382e tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091608 Jul 01 19:44:54.628723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 373/741] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:44:54 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:44:55.797408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-b4358457-bd6e-4cbc-9590-40e24fea458e req-2101dd2c-f713-42d8-abb6-af734dd98767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107094b7-ca95-4b66-b984-2359f2ef2a51", "tag": "7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:55.805642 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-b4358457-bd6e-4cbc-9590-40e24fea458e req-2101dd2c-f713-42d8-abb6-af734dd98767 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:55.806195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-b4358457-bd6e-4cbc-9590-40e24fea458e req-2101dd2c-f713-42d8-abb6-af734dd98767 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:55.817471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-b4358457-bd6e-4cbc-9590-40e24fea458e req-2101dd2c-f713-42d8-abb6-af734dd98767 service nova] Creating event network-changed:7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12 for instance 107094b7-ca95-4b66-b984-2359f2ef2a51 on hv-cinder-83124 Jul 01 19:44:55.823333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-b4358457-bd6e-4cbc-9590-40e24fea458e req-2101dd2c-f713-42d8-abb6-af734dd98767 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085936 Jul 01 19:44:55.823886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 369/742] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:44:57.471404 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:57.472088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:44:57.479030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:57.479457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:57.480222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:57.480653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:57.483300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:57.612334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lazy-loading 'services' on Instance uuid acd8c337-77a5-4fd0-aeef-555fb1ad2d13 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:44:57.741177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-75c50193-ec63-4875-9bd6-084a20a62ddc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-volume_attachments/438480ec-2306-4605-ba85-4b8314088f5c" status: 202 len: 0 microversion: 2.1 time: 0.275300 Jul 01 19:44:57.741787 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 374/743] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:44:57 2022] DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-volume_attachments/438480ec-2306-4605-ba85-4b8314088f5c => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:44:57.838464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-715cef07-e8fc-4908-9bf0-f3d244e3e335 req-3923a4cf-2df2-4f4e-9937-3a203ad1efa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107094b7-ca95-4b66-b984-2359f2ef2a51", "tag": "7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:57.846544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-715cef07-e8fc-4908-9bf0-f3d244e3e335 req-3923a4cf-2df2-4f4e-9937-3a203ad1efa7 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:57.846973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-715cef07-e8fc-4908-9bf0-f3d244e3e335 req-3923a4cf-2df2-4f4e-9937-3a203ad1efa7 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:57.857774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-715cef07-e8fc-4908-9bf0-f3d244e3e335 req-3923a4cf-2df2-4f4e-9937-3a203ad1efa7 service nova] Creating event network-changed:7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12 for instance 107094b7-ca95-4b66-b984-2359f2ef2a51 on hv-cinder-83124 Jul 01 19:44:57.862621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-715cef07-e8fc-4908-9bf0-f3d244e3e335 req-3923a4cf-2df2-4f4e-9937-3a203ad1efa7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028777 Jul 01 19:44:57.863185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 370/744] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:44:59.920899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b572c36f-ace6-4210-822c-7a465afae58d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:44:59.928520 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b572c36f-ace6-4210-822c-7a465afae58d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:59.929042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b572c36f-ace6-4210-822c-7a465afae58d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:59.952782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b572c36f-ace6-4210-822c-7a465afae58d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Going to try to stop instance {{(pid=124350) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 19:44:59.998385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b572c36f-ace6-4210-822c-7a465afae58d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action" status: 202 len: 0 microversion: 2.1 time: 0.082273 Jul 01 19:44:59.999428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 375/745] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:44:59 2022] POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:00.008127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:00.008830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:00.016356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:00.016859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:00.017751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:00.018230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:00.157804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:00.168885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5d750399-dce8-4e51-a24c-428f3049a465 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.164905 Jul 01 19:45:00.169472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 371/746] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:00 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:01.189591 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:01.190333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:01.198844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:01.199298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:01.200088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:01.200524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:01.337837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:01.349115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8b46085a-9e86-45d9-b82d-89216085f9fb tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.163613 Jul 01 19:45:01.349896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 376/747] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:01 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:02.374533 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:02.375335 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:02.383607 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:02.384171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:02.385120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:02.385658 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:02.527377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:02.538901 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bccdcc97-1a09-41d0-a5ab-7631010197ad tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.169163 Jul 01 19:45:02.539439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 372/748] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:02 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:03.556181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:03.556828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:03.563676 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:03.564129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:03.564893 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:03.565324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:03.706874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:03.716011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3dcab202-52e7-4956-a247-f89d6142075b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.163866 Jul 01 19:45:03.716600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 377/749] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:03 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:04.734263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:04.734863 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:04.742004 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:04.742478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:04.743236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:04.743661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:04.874993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:04.883032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7149b700-b90a-40c9-a968-e4adc4791e5d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.152924 Jul 01 19:45:04.883607 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 373/750] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:04 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:05.902876 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:05.903502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:05.905699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=30 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:05.920510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:05.921017 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:05.921882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:05.922406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:06.062467 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:06.074510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c2a7c75d-6569-487e-a457-f89222b95ece tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.176365 Jul 01 19:45:06.075321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 378/751] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:05 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:07.092670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:07.093275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:07.095750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=30 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:07.101233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:07.101729 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:07.102511 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:07.102943 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:07.105640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=82 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:07.255049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:07.264955 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cd5739d8-b26a-4091-9799-f918859421cd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.176012 Jul 01 19:45:07.265707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 374/752] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:07 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:08.289187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:08.290339 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:08.301177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:08.301925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:08.303827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:08.304568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:08.442607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:08.451116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f2edc21a-d972-4ca1-ab05-001e09687e9b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.168410 Jul 01 19:45:08.451670 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 379/753] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:08 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:09.471673 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:09.472666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:09.483708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:09.484492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:09.485731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:09.486505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:09.542487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:45:09.543096 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 19:45:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:45:09.625751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:09.633937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-84527c6c-5bf5-4ae7-9caf-ff73ac9b38c7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.168775 Jul 01 19:45:09.634510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 375/754] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:09 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:10.655125 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:10.656095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:10.666856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:10.667308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:10.668076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:10.668512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:10.808683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:10.816904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5da812c-fda8-43f0-ad9b-c3271ac0b5c0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.168219 Jul 01 19:45:10.817518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 380/755] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:10 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:11.838438 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:11.839028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:11.847027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:11.847556 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:11.848394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:11.848885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:11.992622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:12.000726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-983ff818-7649-4156-a9f8-a3c0ef7c1daa tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.168847 Jul 01 19:45:12.001294 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 376/756] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:11 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:13.018345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:13.018936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:13.025891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:13.026375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:13.027137 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:13.027571 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:13.161920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:13.169725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f6acb52f-fa65-4f53-8ea7-824117b01774 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.155390 Jul 01 19:45:13.170325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 381/757] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:13 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:14.195978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:14.197376 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:14.208458 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:14.209196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:14.210598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:14.211343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:14.348706 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:14.358524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-46771f63-0ecf-4e22-bf0f-c26b132f8a7c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.169010 Jul 01 19:45:14.359090 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 377/758] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:14 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:15.379502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:15.380040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:15.388698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:15.389144 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:15.389912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:15.390385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:15.532677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:15.540892 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2592189-a48a-466c-89ac-eccc3a54310b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.167878 Jul 01 19:45:15.541449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 382/759] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:15 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:16.568212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:16.569252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:16.578318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:16.578773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:16.579543 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:16.579979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:16.712954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:16.723503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1829076f-756e-4af1-8224-3d3cfe22603f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.161796 Jul 01 19:45:16.724278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 378/760] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:16 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:17.094938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:17.095465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:17.102768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:17.103212 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:17.103966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:17.104389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:17.127406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lazy-loading 'flavor' on Instance uuid 9f8e5709-0263-4b71-a560-06dc39f1a1d6 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:45:17.216578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d030c6b-fcc7-4079-b0aa-11b204becfcf tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "POST /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6/action" status: 202 len: 0 microversion: 2.1 time: 0.125421 Jul 01 19:45:17.217123 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 383/761] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:45:17 2022] POST /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:17.225699 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:17.226538 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:17.233186 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:17.233796 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:17.234655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:17.235252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:17.372716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:17.380671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f5ed1349-df35-48b8-97ef-659a810d8ff3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.158964 Jul 01 19:45:17.381206 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 379/762] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:17 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:17.747487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:17.748194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:17.755174 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:17.755622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:17.756383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:17.756819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:17.910828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:17.922332 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f169fa1-d7ca-4492-b88f-6c2ab7d8efec tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.180548 Jul 01 19:45:17.923062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 384/763] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:17 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:18.399044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:18.399902 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:18.406693 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:18.407158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:18.407889 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:18.408310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:18.562799 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:18.575577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e596091c-f80e-4ad1-97bd-c68375c32b7f tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.180127 Jul 01 19:45:18.576065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 380/764] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:18 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:18.945870 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:18.947139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:18.954726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:18.955175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:18.955945 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:18.956380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:19.116750 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:19.124968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f5cb75ed-cb76-4cff-8229-6a8185c645e0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.184646 Jul 01 19:45:19.125540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 385/765] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:18 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:19.596909 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:19.597985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:19.607689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:19.608126 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:19.608932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:19.609347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:19.742320 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:19.750049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2caad9ee-71be-4731-af49-8da6b5c3f371 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.159614 Jul 01 19:45:19.750621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 381/766] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:19 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:20.148787 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:20.149723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:20.160694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:20.161437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:20.162860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:20.163583 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:20.304227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:20.313733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-90ed3e68-28ab-47f2-b1c1-4c07d9a57c74 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1678 microversion: 2.1 time: 0.171405 Jul 01 19:45:20.314367 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 386/767] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:20 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:20.772055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:20.773028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:20.783992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:20.784741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:20.786013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:20.786813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:20.935491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:20.945056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-97625cf6-87e7-497b-9475-cf28ce01a2f7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.179615 Jul 01 19:45:20.945674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 382/768] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:20 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:21.335305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:21.336170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:21.344715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.345156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:21.345910 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.346372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:21.348995 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:21.484540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:21.495922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-568a8019-1e5a-402f-a89e-cfb18227e5c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1655 microversion: 2.1 time: 0.167243 Jul 01 19:45:21.496679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 387/769] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:21 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:21.517661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a7952b81-b4e0-4cab-a543-db957a15328e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:21.524426 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7952b81-b4e0-4cab-a543-db957a15328e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.524881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7952b81-b4e0-4cab-a543-db957a15328e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:21.548057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a7952b81-b4e0-4cab-a543-db957a15328e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Going to try to start instance {{(pid=124349) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 19:45:21.593695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a7952b81-b4e0-4cab-a543-db957a15328e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action" status: 202 len: 0 microversion: 2.1 time: 0.079516 Jul 01 19:45:21.594283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 383/770] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:45:21 2022] POST /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:21.602539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:21.603151 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:21.609275 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.609727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:21.610526 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.610962 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:21.781721 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:21.789743 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c93b7419-4978-4144-a1e6-6784f8f5ff33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1664 microversion: 2.1 time: 0.191163 Jul 01 19:45:21.790372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 388/771] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:21 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:21.963696 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:21.964395 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:21.971575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.972028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:21.972821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:21.973234 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:22.196188 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:22.204504 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1d91c402-20e7-4721-b16c-7e112993201e tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.245111 Jul 01 19:45:22.205319 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 384/772] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:21 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:22.811088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:22.811844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:22.820605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:22.821175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:22.822527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:22.823061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:22.961366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:22.969264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1ca49cef-a990-40c3-8204-f2cd6df54bcd tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1664 microversion: 2.1 time: 0.164375 Jul 01 19:45:22.969866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 389/773] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:22 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:23.226330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:23.227155 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:23.236017 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:23.236492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:23.237251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:23.237713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:23.371973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:23.380228 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0eca4ca5-01fe-4d53-a4bc-49fdca7f193a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.160707 Jul 01 19:45:23.380793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 385/774] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:23 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:23.991179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:23.992098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:24.003312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:24.004217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:24.005491 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:24.006248 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:24.148530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:24.157711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-36289fe9-4e2a-4e5a-b00e-60807a89e478 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1668 microversion: 2.1 time: 0.173224 Jul 01 19:45:24.158290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 390/775] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:23 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:24.401517 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:24.402682 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:24.409827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:24.410397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:24.411178 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:24.411638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:24.552541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:24.560251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a60d5a24-8a8d-4456-af6a-d801b6696ad4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.165197 Jul 01 19:45:24.560815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 386/776] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:24 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:25.580828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:25.581638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:25.590745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.591185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.591968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.592401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.727599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:25.735212 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a0de909e-ec68-48a1-b2ff-de57cbd6f599 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.160136 Jul 01 19:45:25.735766 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 391/777] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:25 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:25.779037 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:25.779576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:25.786695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.787144 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.787904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.788334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.811686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1743f793-acff-4020-a193-c3f4a625f1e9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/ips" status: 200 len: 149 microversion: 2.1 time: 0.037779 Jul 01 19:45:25.812232 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 387/778] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:45:25 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:25.823222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a894dc5a-2c29-4198-bb67-f84781566167"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:25.824357 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:25.831127 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.831505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.832263 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.832691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.921031 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Invalid volume: volume a894dc5a-2c29-4198-bb67-f84781566167 is already attached to instances: b46dff9c-709e-4bb6-b3ee-d2247114ec8c Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/os-volume_attachments HTTP/1.1 Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 74 Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:45:25.922836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {"volumeAttachment": {"volumeId": "a894dc5a-2c29-4198-bb67-f84781566167"}} Jul 01 19:45:25.924569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Invalid volume: volume a894dc5a-2c29-4198-bb67-f84781566167 is already attached to instances: b46dff9c-709e-4bb6-b3ee-d2247114ec8c Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '207060e8-4e36-4563-8fb9-54b21a39db6a', 'body': {'volumeAttachment': {'volumeId': 'a894dc5a-2c29-4198-bb67-f84781566167'}}} Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a894dc5a-2c29-4198-bb67-f84781566167 is already attached to instances: b46dff9c-709e-4bb6-b3ee-d2247114ec8c Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:25.925500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a894dc5a-2c29-4198-bb67-f84781566167 is already attached to instances: b46dff9c-709e-4bb6-b3ee-d2247114ec8c Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:25.926966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a894dc5a-2c29-4198-bb67-f84781566167 is already attached to instances: b46dff9c-709e-4bb6-b3ee-d2247114ec8c Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 400 to user: Invalid volume: volume a894dc5a-2c29-4198-bb67-f84781566167 is already attached to instances: b46dff9c-709e-4bb6-b3ee-d2247114ec8c {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f9bd3d7-8c01-4e9b-9aba-70b102189aab tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105412 Jul 01 19:45:25.928386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 392/779] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:45:25 2022] POST /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:45:25.933319 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:25.933808 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:25.940005 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.940481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.941242 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:25.941687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:25.966310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:45:26.012363 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:26.050034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d9524691-476d-45f2-883c-293e10ee95b2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 204 len: 0 microversion: 2.1 time: 0.119507 Jul 01 19:45:26.050643 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 388/780] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:45:25 2022] DELETE /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:45:26.059222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:26.059899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:26.067023 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:26.067469 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:26.068235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:26.068703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:26.209432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:26.217976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3503ec39-17e8-459b-87f3-09241f7eb3c6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1681 microversion: 2.1 time: 0.162663 Jul 01 19:45:26.218667 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 393/781] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:26 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:26.757852 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:26.759111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:26.767012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:26.767466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:26.768226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:26.768659 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:26.905111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:26.913488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ab5295de-44dd-44bf-ad8e-62aeb95a81da tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.163061 Jul 01 19:45:26.914082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 389/782] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:26 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:27.240065 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:27.241066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:27.250237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:27.250690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:27.251459 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:27.251896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:27.398379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:27.406045 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cac69287-8e53-46ac-ae8d-f2a6ba5dd175 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1681 microversion: 2.1 time: 0.172558 Jul 01 19:45:27.406617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 394/783] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:27 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:27.933230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:27.933868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:27.941101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:27.941611 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:27.942326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:27.942782 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:28.127979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:28.136030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4e6bfc66-7d11-4ead-af5e-5d1c0a0b57dc tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.209084 Jul 01 19:45:28.136597 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 390/784] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:27 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:28.424763 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:28.425379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:28.432295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:28.432745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:28.433515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:28.433972 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:28.567334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:28.575253 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-887f4b54-bc3f-4b80-92aa-20096c8c8dda tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1681 microversion: 2.1 time: 0.154425 Jul 01 19:45:28.575848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 395/785] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:28 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:29.153012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:29.153661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:29.161689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:29.162325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:29.163231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:29.163747 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:29.309694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:29.322322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-057a17ca-726d-4cc3-86d0-b79d3011907a tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.173169 Jul 01 19:45:29.332497 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 391/786] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:29 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:29.372210 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-5666f343-5ed4-48df-b846-8a23cbb3f20a req-4c2e6bb1-9212-4439-9498-697034e00058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207060e8-4e36-4563-8fb9-54b21a39db6a", "name": "network-vif-deleted", "tag": "144feb40-f020-42da-b3cf-2d3d806cb139"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:29.380821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5666f343-5ed4-48df-b846-8a23cbb3f20a req-4c2e6bb1-9212-4439-9498-697034e00058 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:29.381444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5666f343-5ed4-48df-b846-8a23cbb3f20a req-4c2e6bb1-9212-4439-9498-697034e00058 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:29.392436 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-5666f343-5ed4-48df-b846-8a23cbb3f20a req-4c2e6bb1-9212-4439-9498-697034e00058 service nova] Creating event network-vif-deleted:144feb40-f020-42da-b3cf-2d3d806cb139 for instance 207060e8-4e36-4563-8fb9-54b21a39db6a on hv-cinder-83124 Jul 01 19:45:29.397589 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-5666f343-5ed4-48df-b846-8a23cbb3f20a req-4c2e6bb1-9212-4439-9498-697034e00058 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089075 Jul 01 19:45:29.398229 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 396/787] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:45:29.592785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:29.593312 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:29.599740 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:29.600196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:29.600975 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:29.601414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:29.666860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:29.674792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ffea6ba0-59af-423c-afd2-0d0956a2aaf5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1613 microversion: 2.1 time: 0.086078 Jul 01 19:45:29.685557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 392/788] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:29 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:30.341102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:30.341996 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:30.348887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:30.349468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:30.350368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:30.350874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:30.510329 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:30.519009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-67683a3c-3028-4895-9198-86f15e560646 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.182848 Jul 01 19:45:30.519656 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 397/789] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:30 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:30.692403 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:30.692964 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:30.700209 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:30.700650 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:30.701442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:30.701892 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:30.734775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:30.735217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:30.735666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'fault' on Instance uuid 207060e8-4e36-4563-8fb9-54b21a39db6a {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:45:30.778687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:30.786253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a9ba11f9-4684-4146-8e12-b8c30f3b679c tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 200 len: 1331 microversion: 2.1 time: 0.097804 Jul 01 19:45:30.786820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 393/790] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:30 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:31.541489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:31.542587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:31.549906 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.550385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.551115 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.551579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.691998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:31.700700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dbb59895-68d5-4b4d-8663-294a1cf9ddc3 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1570 microversion: 2.1 time: 0.165867 Jul 01 19:45:31.701274 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 398/791] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:31 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:31.717767 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:31.718367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:31.725009 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.725478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.726296 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.726733 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.803148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:31.803760 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:31.810110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.810545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.811348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a4ed0c78-e506-41e6-9bef-6e82234361d4 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "POST /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6/action" status: 202 len: 0 microversion: 2.1 time: 0.097779 Jul 01 19:45:31.811468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.811740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.815158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 394/792] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:45:31 2022] POST /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:31.819856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:31.820442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:31.826093 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:45:31.827019 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.827471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a HTTP/1.1 Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:45:31.827932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:45:31.829194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '207060e8-4e36-4563-8fb9-54b21a39db6a'} Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:45:31.829971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:45:31.831175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:31.832262 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:31.832338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:45:31.832423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:31.832612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-262f0901-bb1e-4e40-bfc0-5349b6e84003 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 404 len: 111 microversion: 2.1 time: 0.030079 Jul 01 19:45:31.832612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 399/793] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:31 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:45:31.838146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-700adf71-aa3d-41ee-9277-c8a9280d279d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '.version_select at 0x7f47647379d0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:31.864274 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-700adf71-aa3d-41ee-9277-c8a9280d279d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543623714" status: 202 len: 0 microversion: 2.1 time: 0.029839 Jul 01 19:45:31.864848 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 400/794] 10.222.0.61 () {58 vars in 1217 bytes} [Fri Jul 1 19:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543623714 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:32.298933 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:32.308779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f5f4c005-0ee0-46da-98cd-06464fbfdc44 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1518 microversion: 2.1 time: 0.492303 Jul 01 19:45:32.309397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 395/795] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:31 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1518 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:32.901159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:32.901706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:32.908543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:32.909008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:32.909748 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:32.910195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:33.001127 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'services' on Instance uuid b46dff9c-709e-4bb6-b3ee-d2247114ec8c {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:45:33.083893 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2ce66e58-045e-4be3-9e4f-70f75952d8ea tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments/a894dc5a-2c29-4198-bb67-f84781566167" status: 202 len: 0 microversion: 2.1 time: 0.187157 Jul 01 19:45:33.084469 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 401/796] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:45:32 2022] DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments/a894dc5a-2c29-4198-bb67-f84781566167 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:33.092937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:33.093885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:33.100822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:33.101272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:33.102137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:33.102588 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:33.137132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8948d12f-63c9-4000-8112-7fae19a39b39 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048125 Jul 01 19:45:33.137703 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 396/797] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:45:33 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:33.326664 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:33.338948 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:33.347442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:33.347848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:33.350882 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:33.351712 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:33.393454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-b6ec956d-afcf-4471-b1cb-1b1d5d5fd419 req-c832ece9-38f1-400a-bbb3-86caa4fbef33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "name": "network-vif-unplugged", "status": "completed", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:33.403391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b6ec956d-afcf-4471-b1cb-1b1d5d5fd419 req-c832ece9-38f1-400a-bbb3-86caa4fbef33 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:33.404905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b6ec956d-afcf-4471-b1cb-1b1d5d5fd419 req-c832ece9-38f1-400a-bbb3-86caa4fbef33 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:33.417009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.compute.server_external_events [req-b6ec956d-afcf-4471-b1cb-1b1d5d5fd419 req-c832ece9-38f1-400a-bbb3-86caa4fbef33 service nova] Unable to find a host for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6. Dropping event network-vif-unplugged {{(pid=124350) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 19:45:33.418165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-b6ec956d-afcf-4471-b1cb-1b1d5d5fd419 req-c832ece9-38f1-400a-bbb3-86caa4fbef33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.108299 Jul 01 19:45:33.419057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 402/798] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 19:45:33.489291 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:33.497026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2e580494-1079-481e-8d29-d68f7fdca290 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1520 microversion: 2.1 time: 0.174308 Jul 01 19:45:33.497594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 397/799] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:33 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:34.149707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:34.151166 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:34.158770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:34.159468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:34.160236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:34.160669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:34.193003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-47ec1535-9636-4869-8ecf-7c6e9f24b40b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Jul 01 19:45:34.193590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 403/800] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:45:34 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:34.515689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:34.516308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:34.523302 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:34.523789 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:34.524586 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:34.525021 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:34.663725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:34.671852 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-42db18e2-bf33-44cb-9d8f-dc51a5abd50c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.160158 Jul 01 19:45:34.672430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 398/801] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:34 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:35.205190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:35.206125 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:35.212710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.213159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.213927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.214372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.244056 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-29dbd339-fc4a-4831-8d57-76dea746cccd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042970 Jul 01 19:45:35.244626 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 404/802] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:45:35 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:45:35.303124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:35.303618 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:35.311725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.312102 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.312862 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.313327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.343337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:45:35.425015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-63c62ce2-ce71-4374-b5f6-298ed989d237 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 204 len: 0 microversion: 2.1 time: 0.125523 Jul 01 19:45:35.425596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 399/803] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:45:35 2022] DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:45:35.433824 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:35.434476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:35.440742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.441203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.442017 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.442419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.586469 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:35.594237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f32a134-6617-490a-85a3-91b8499f891a tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1683 microversion: 2.1 time: 0.164246 Jul 01 19:45:35.594838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 405/804] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:35 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:35.689541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:35.690241 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:35.697337 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.697774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.698666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:35.699091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:35.839938 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:35.851388 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9c36549c-7959-4e6b-9f04-0179fe033ab8 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.165858 Jul 01 19:45:35.852143 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 400/805] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:35 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:36.616003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:36.616950 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:36.621028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:36.630018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:36.630804 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:36.632062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:36.632775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:36.638407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:36.781473 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:36.793235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-537a4aa8-33a9-4dce-b1d4-c7cfce8def18 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1683 microversion: 2.1 time: 0.183373 Jul 01 19:45:36.794039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 406/806] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:36 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:36.875290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:36.875874 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:36.883727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:36.884218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:36.885063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:36.885542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:37.019067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:37.026733 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-94743073-c902-4e9c-bf40-c45ebd101fe0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.158034 Jul 01 19:45:37.027303 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 401/807] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:36 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:37.820805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:37.822221 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:37.833375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:37.834166 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:37.835418 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:37.836130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:37.970255 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:37.978118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0095ec33-b0ed-4acc-9c9d-01f09b36437b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1683 microversion: 2.1 time: 0.163922 Jul 01 19:45:37.978677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 407/808] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:37 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:38.044559 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:38.045152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:38.047691 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:38.054382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:38.054838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:38.055774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:38.056214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:38.059421 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:38.204255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:38.212093 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a118c076-fc53-4240-aa31-e8fac7ee3134 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.171480 Jul 01 19:45:38.212661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 402/809] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:38 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:38.995755 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:38.996341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:39.003567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:39.004021 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:39.004806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:39.005238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:39.137204 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:39.144917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e0d02d02-4c02-47e9-8ea9-d23645d66784 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1683 microversion: 2.1 time: 0.153329 Jul 01 19:45:39.145508 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 408/810] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:38 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:39.229992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:39.230610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:39.240594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:39.241317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:39.242599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:39.243340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:39.408844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:39.417281 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7845e2bc-c329-41f1-b32c-5f7034890dc5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.192309 Jul 01 19:45:39.417893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 403/811] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:39 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:39.630465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-7d698167-cb57-4e72-88e2-4981c8401b69 req-f7fee48c-ac95-4dd5-8544-e3aa0bbab2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46dff9c-709e-4bb6-b3ee-d2247114ec8c", "name": "network-vif-deleted", "tag": "550bd6a9-51b7-49dd-8101-bc9890561ab1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:39.638856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-7d698167-cb57-4e72-88e2-4981c8401b69 req-f7fee48c-ac95-4dd5-8544-e3aa0bbab2cf service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:39.639246 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-7d698167-cb57-4e72-88e2-4981c8401b69 req-f7fee48c-ac95-4dd5-8544-e3aa0bbab2cf service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:39.650373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-7d698167-cb57-4e72-88e2-4981c8401b69 req-f7fee48c-ac95-4dd5-8544-e3aa0bbab2cf service nova] Creating event network-vif-deleted:550bd6a9-51b7-49dd-8101-bc9890561ab1 for instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c on hv-cinder-83124 Jul 01 19:45:39.655373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-7d698167-cb57-4e72-88e2-4981c8401b69 req-f7fee48c-ac95-4dd5-8544-e3aa0bbab2cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028563 Jul 01 19:45:39.655972 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 409/812] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:40.170210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:40.170210 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:40.187859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:40.187859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:40.188634 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:40.189053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:40.224376 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:40.224828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:40.225467 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'fault' on Instance uuid b46dff9c-709e-4bb6-b3ee-d2247114ec8c {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:45:40.272967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:40.282434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a1b2d64c-2f41-456f-a2e9-c165f3ab314f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 200 len: 1332 microversion: 2.1 time: 0.124142 Jul 01 19:45:40.283332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 404/813] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:40 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:40.435715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:40.436407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:40.443259 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:40.443697 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:40.444736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:40.445162 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:40.583083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:40.590957 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b51711f-0734-493a-b559-826a753c9b69 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.159993 Jul 01 19:45:40.591514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 410/814] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:40 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:41.300098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:41.300655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:41.307582 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:41.308035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:41.308841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:41.309276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:41.323770 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c HTTP/1.1 Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:45:41.325397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:45:41.326928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'b46dff9c-709e-4bb6-b3ee-d2247114ec8c'} Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:45:41.327751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:45:41.329196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:45:41.330654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:45:41.330654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9f146fc9-9703-4638-ad71-5e851382f345 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 404 len: 111 microversion: 2.1 time: 0.030759 Jul 01 19:45:41.330654 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 405/815] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:41 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:45:41.335934 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fc166d99-1dce-4a5f-805c-3574ac362cd8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '.version_select at 0x7f476486d1f0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:41.355663 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fc166d99-1dce-4a5f-805c-3574ac362cd8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746256278" status: 202 len: 0 microversion: 2.1 time: 0.023537 Jul 01 19:45:41.356204 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 411/816] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jul 1 19:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746256278 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:45:41.608094 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:41.608944 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:41.614945 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:41.615392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:41.616260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:41.616689 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:41.692688 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-db5c022d-6c88-4122-8431-fb6c2a590447 req-4c060907-40c6-4ee1-bf9b-af2b4d0e175b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "name": "network-vif-plugged", "status": "completed", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:41.705154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-db5c022d-6c88-4122-8431-fb6c2a590447 req-4c060907-40c6-4ee1-bf9b-af2b4d0e175b service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:41.705805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-db5c022d-6c88-4122-8431-fb6c2a590447 req-4c060907-40c6-4ee1-bf9b-af2b4d0e175b service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:41.724877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-db5c022d-6c88-4122-8431-fb6c2a590447 req-4c060907-40c6-4ee1-bf9b-af2b4d0e175b service nova] Creating event network-vif-plugged:1e7ea8a1-39e7-4142-b19c-19006b3a3154 for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 on hv-cinder-83124 Jul 01 19:45:41.730730 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-db5c022d-6c88-4122-8431-fb6c2a590447 req-4c060907-40c6-4ee1-bf9b-af2b4d0e175b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042110 Jul 01 19:45:41.731943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 412/817] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:45:41.769714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:41.778695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0fdeace6-75ac-4dc8-849b-65364f05c7cb tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.173902 Jul 01 19:45:41.779493 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 406/818] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:41 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:42.011902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0af7ffbd-2aff-42ef-bfff-35a78986bfa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: .version_select at 0x7f47647e9af0>, body: {"keypair": {"name": "tempest-keypair-1807172828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtIbJr1tNGkleAWcgP0XtcqzM3D4JJZGlLzpo+wrsbEsF1TFIsVxObQFAGtnF0+Cs+muG6zpFAsRt/Jjap7OgAvHkOth+RPX6rmSMpqox0eKGGfrDlReTFDXnOEbt8Mlw=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:42.027558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-0af7ffbd-2aff-42ef-bfff-35a78986bfa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:45:42.032013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-0af7ffbd-2aff-42ef-bfff-35a78986bfa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:45:42.056923 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0af7ffbd-2aff-42ef-bfff-35a78986bfa9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049268 Jul 01 19:45:42.057755 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 413/819] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:45:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:42.795963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:42.796586 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:42.803168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:42.803610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:42.804366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:42.804792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:42.942293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:42.950720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f24337e8-027b-4ea6-99ba-2630c3f16d91 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1576 microversion: 2.1 time: 0.158676 Jul 01 19:45:42.951290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 407/820] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:42 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:43.318795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-813049155", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bede229f-3edc-4006-b398-af17b8fdb00e"}], "security_groups": [{"name": "tempest-securitygroup--1996829122"}], "key_name": "tempest-keypair-1807172828", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:43.424461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] validate_networks() for [('bede229f-3edc-4006-b398-af17b8fdb00e', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:45:43.865756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:45:43.866216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:45:43.866685 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:45:43.867090 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:45:43.867495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:45:43.877392 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:43.877833 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:43.878662 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:43.879093 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:43.897106 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:45:43.901825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:45:43.913850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:45:43.916291 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:45:43.961449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [9e6d4a3c-1b2c-4c1d-9ca7-8c8238ff2037] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 19:45:43.970483 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:43.971099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:43.980832 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:43.981447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:43.982663 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:43.983316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:44.127594 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:44.135234 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-28aceec4-0365-409e-a79d-ff299872e9a5 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1563 microversion: 2.1 time: 0.170830 Jul 01 19:45:44.135799 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 408/821] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:43 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:44.969017 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [9e6d4a3c-1b2c-4c1d-9ca7-8c8238ff2037] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 58562. Jul 01 19:45:44.973665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-93789794-615b-4bcd-bd99-88b3eadedf7f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.659948 Jul 01 19:45:44.974418 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 414/822] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:45:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:45:44.984641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-961be4d8-7d8d-4667-8513-a9348c56b68f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:44.985255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-961be4d8-7d8d-4667-8513-a9348c56b68f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:45.039134 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-961be4d8-7d8d-4667-8513-a9348c56b68f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:45.046373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-961be4d8-7d8d-4667-8513-a9348c56b68f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1241 microversion: 2.1 time: 0.065687 Jul 01 19:45:45.047168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 409/823] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:44 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:45.651256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:45.651747 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:45.658735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:45.659309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:45.660082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:45.661069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:45.695254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b4beae8a-239a-4a97-8cea-fded6d940cee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments/0ef163ae-ef03-4f2d-b6e7-21bb8a4a57a7" status: 200 len: 194 microversion: 2.20 time: 0.048524 Jul 01 19:45:45.695863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 415/824] 10.222.0.61 () {60 vars in 1453 bytes} [Fri Jul 1 19:45:45 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments/0ef163ae-ef03-4f2d-b6e7-21bb8a4a57a7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:45.759878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:45.760404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:45.766917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:45.767366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:45.768135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:45.768568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:45.850311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lazy-loading 'services' on Instance uuid fc929a10-068e-444f-bc59-ab78f9821237 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:45:45.967383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e1d39b40-d543-4e89-a2a5-703134266194 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments/0ef163ae-ef03-4f2d-b6e7-21bb8a4a57a7" status: 202 len: 0 microversion: 2.20 time: 0.211361 Jul 01 19:45:45.968070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 410/825] 10.222.0.61 () {60 vars in 1456 bytes} [Fri Jul 1 19:45:45 2022] DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments/0ef163ae-ef03-4f2d-b6e7-21bb8a4a57a7 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:45:45.976933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:45.977926 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:45.984304 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:45.984796 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:45.985570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:45.985993 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:46.018669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2375a63e-5355-4888-9807-7499c46b3d50 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045617 Jul 01 19:45:46.019222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 416/826] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jul 1 19:45:45 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:46.064208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:46.064957 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:46.072516 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:46.072972 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:46.073763 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:46.074248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:46.142932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:46.153005 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c1c8bc49-62e9-4df3-a9d2-23d2c85922c1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1301 microversion: 2.1 time: 0.093158 Jul 01 19:45:46.155695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 411/827] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:46 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:47.030797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:47.031747 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:47.038451 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:47.038899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:47.039700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:47.040341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:47.070827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5499ef90-bd60-4bc7-a316-097e946d8faa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045033 Jul 01 19:45:47.071813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 417/828] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jul 1 19:45:47 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:47.171307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:47.171891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:47.179632 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:47.180683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:47.181463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:47.181918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:47.330804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:47.341405 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3cf1d5ff-3f23-48e9-85bf-1f65e4a4d3db tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.174170 Jul 01 19:45:47.342759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 412/829] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:47 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:47.950062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-434c76ab-88c0-4b3c-b7b0-1511f296410c req-70e89426-bf37-4127-99dd-a87416ee4936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be86e9b5-d5ca-4775-ba1b-041e6031db62", "tag": "a59df434-bb84-4057-859f-34ae4a4f55d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:47.969157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-434c76ab-88c0-4b3c-b7b0-1511f296410c req-70e89426-bf37-4127-99dd-a87416ee4936 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:47.969739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-434c76ab-88c0-4b3c-b7b0-1511f296410c req-70e89426-bf37-4127-99dd-a87416ee4936 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:47.983849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-434c76ab-88c0-4b3c-b7b0-1511f296410c req-70e89426-bf37-4127-99dd-a87416ee4936 service nova] Creating event network-changed:a59df434-bb84-4057-859f-34ae4a4f55d6 for instance be86e9b5-d5ca-4775-ba1b-041e6031db62 on hv-cinder-83124 Jul 01 19:45:47.989713 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-434c76ab-88c0-4b3c-b7b0-1511f296410c req-70e89426-bf37-4127-99dd-a87416ee4936 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043732 Jul 01 19:45:47.990398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 418/830] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:45:48.083771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:48.085136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:48.091713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.092367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.093103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.093694 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.126595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-09549d74-040e-4962-a826-097e3aa19d92 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047018 Jul 01 19:45:48.127385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 413/831] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jul 1 19:45:48 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:48.196025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:48.197679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:48.204156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.204606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.205375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.205808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.247695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:45:48.352966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d90a01a-17a5-49f7-8f1d-8fc049d01117 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 204 len: 0 microversion: 2.20 time: 0.160714 Jul 01 19:45:48.353505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 419/832] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jul 1 19:45:48 2022] DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 19:45:48.360680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:48.361980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:48.366456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:48.367324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:48.371707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.372791 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.373861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.374493 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.374703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.375138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.376243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:48.377018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:48.584283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:48.590677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:48.594494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-24863864-fe15-4705-a4bb-706ae51d34e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.238934 Jul 01 19:45:48.599054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:48.599883 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 414/833] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:48 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:48.600597 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:48.601765 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec683948-6bab-4aa9-95d6-41abb02ff5c0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.242563 Jul 01 19:45:48.602928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 420/834] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:48 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:49.615725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:49.616678 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:49.624897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:49.625505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:49.626570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:49.627018 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:49.627780 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:49.628202 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:49.632211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:49.632657 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:49.633411 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:49.633841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:49.823531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:49.827437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:49.831565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-53518497-420e-4e02-91d8-e7e96f639cff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.222263 Jul 01 19:45:49.832157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 415/835] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:49 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:49.840841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:49.840841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:49.842091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d983ddd-7489-441b-b373-08872bcccc0b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.223358 Jul 01 19:45:49.842647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 421/836] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:49 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:50.852728 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:50.853705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:50.862131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:50.862579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:50.862711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:50.862854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:50.863658 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:50.864089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:50.869592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:50.870060 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:50.870818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:50.871251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:51.054923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:51.063727 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b78e414b-8f56-451a-969b-ef2ee104de27 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.217483 Jul 01 19:45:51.064053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:51.064452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 416/837] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:50 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:51.072690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:51.074214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:51.075373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5082f423-2270-4152-b850-f582d0173550 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.217815 Jul 01 19:45:51.075921 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 422/838] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:50 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:52.081111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:52.081701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:52.088751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:52.089200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:52.089987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:52.090443 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:52.092707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:52.093373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:52.100244 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:52.100751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:52.101513 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:52.101966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:52.289750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:52.293105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:52.297629 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b987d59e-7e58-4a16-925a-c35840c7f415 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.220522 Jul 01 19:45:52.298208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 417/839] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:52 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:52.301615 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:52.303233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:52.304500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-df407dc8-04c3-48ee-988e-bcc86a69653d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.215683 Jul 01 19:45:52.305103 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 423/840] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:52 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:53.317245 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:53.317840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:53.324601 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:53.325594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:53.326247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:53.326778 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:53.327681 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:53.328195 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:53.333650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:53.334215 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:53.335129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:53.335665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:53.523400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:53.531283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:53.532257 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1630181e-67be-4e93-927d-4a5b334933f9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.219669 Jul 01 19:45:53.532834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 418/841] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:53 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:53.544624 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:53.546148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:53.547349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f46c0a4f-4590-4616-95a5-0521f0902fe6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1720 microversion: 2.20 time: 0.227665 Jul 01 19:45:53.547898 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 424/842] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:53 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:54.549019 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:54.549736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:54.556957 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:54.557443 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:54.558346 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:54.558838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:54.566158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:54.566850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:54.568938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:54.569891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:54.578978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:54.579554 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:54.580673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:54.581307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:54.622130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:54.664847 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:54.667340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:54.674825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:54.682199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:54.692062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dad1d957-eaf3-4198-8e40-ea3d4e762c17 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 200 len: 1654 microversion: 2.20 time: 0.129838 Jul 01 19:45:54.692772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 425/843] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:54 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 1654 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:45:54.705808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e15d164f-4cb6-48e3-80d8-b0f6eb06f77e req-beeb0be0-67a3-494a-bb9f-fe1d1950ffcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc929a10-068e-444f-bc59-ab78f9821237", "name": "network-vif-deleted", "tag": "7ff227c5-7dfc-4476-b094-d71e27fb265f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:54.720038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e15d164f-4cb6-48e3-80d8-b0f6eb06f77e req-beeb0be0-67a3-494a-bb9f-fe1d1950ffcb service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:54.720827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e15d164f-4cb6-48e3-80d8-b0f6eb06f77e req-beeb0be0-67a3-494a-bb9f-fe1d1950ffcb service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:54.734752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e15d164f-4cb6-48e3-80d8-b0f6eb06f77e req-beeb0be0-67a3-494a-bb9f-fe1d1950ffcb service nova] Creating event network-vif-deleted:7ff227c5-7dfc-4476-b094-d71e27fb265f for instance fc929a10-068e-444f-bc59-ab78f9821237 on hv-cinder-83124 Jul 01 19:45:54.742071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e15d164f-4cb6-48e3-80d8-b0f6eb06f77e req-beeb0be0-67a3-494a-bb9f-fe1d1950ffcb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047041 Jul 01 19:45:54.743251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 426/844] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:54.797233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:54.806385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-02be6733-4047-4f70-a961-44cd03b03671 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.261199 Jul 01 19:45:54.806988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 419/845] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:54 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:55.713313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:55.714198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:55.721225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:55.721969 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:55.722800 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:55.723405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:55.736995 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] HTTP exception thrown: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Request method failure captured: Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 HTTP/1.1 Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv00_qQtwd8knoeezfJHZdyP7qhHUX3oGpQAFhr2VNBGjlTDYV2gmOox3dnpfzZ9Cut9TGmcu9zF5QztxgwZXuw-3nZCpRMVI0M8B_TBEZRgIx4uQ1NldtnGtq5tf1d76yemVofqYaMIzeihQ4yuEbIJ1MQIeNL0AIbp29Bc7jIQmkog Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:45:55.738653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9bc18901e30b4252988c065baa36be3c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: b5040520134e464ea1d534767ea8728e Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:45:55.740362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'fc929a10-068e-444f-bc59-ab78f9821237'} Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:45:55.744610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:45:55.746198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:45:55.747428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Returning 404 to user: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:45:55.747428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-503bc97b-dc09-4d7e-9fb2-67de0f692eab tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 404 len: 111 microversion: 2.20 time: 0.032157 Jul 01 19:45:55.747428 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 427/846] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:55 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:45:55.751478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5d502380-0b99-4101-bc37-d8e329cb0d10 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '.version_select at 0x7f47646ef940>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:55.759863 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:55.774695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5d502380-0b99-4101-bc37-d8e329cb0d10 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345823398" status: 204 len: 0 microversion: 2.20 time: 0.028352 Jul 01 19:45:55.775374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 420/847] 10.222.0.61 () {60 vars in 1258 bytes} [Fri Jul 1 19:45:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345823398 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 19:45:55.775662 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9c4b538d-d63e-4890-aed6-7397660348ea req-977a71b8-b75b-4a97-8309-13d73e795fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be86e9b5-d5ca-4775-ba1b-041e6031db62", "name": "network-vif-plugged", "status": "completed", "tag": "a59df434-bb84-4057-859f-34ae4a4f55d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:55.784627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9c4b538d-d63e-4890-aed6-7397660348ea req-977a71b8-b75b-4a97-8309-13d73e795fa5 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:55.785072 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9c4b538d-d63e-4890-aed6-7397660348ea req-977a71b8-b75b-4a97-8309-13d73e795fa5 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:55.801503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9c4b538d-d63e-4890-aed6-7397660348ea req-977a71b8-b75b-4a97-8309-13d73e795fa5 service nova] Creating event network-vif-plugged:a59df434-bb84-4057-859f-34ae4a4f55d6 for instance be86e9b5-d5ca-4775-ba1b-041e6031db62 on hv-cinder-83124 Jul 01 19:45:55.806707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9c4b538d-d63e-4890-aed6-7397660348ea req-977a71b8-b75b-4a97-8309-13d73e795fa5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Jul 01 19:45:55.808104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 428/848] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:55.823382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:55.824137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:55.830321 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:55.830773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:55.831638 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:55.832021 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:55.998797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:56.006619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d5f53d6-423c-4385-acd5-c50c301cff63 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.188022 Jul 01 19:45:56.007225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 421/849] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:55 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:56.451904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57353522-89cb-4f1e-9fc5-530dd490f5c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'create', calling method: .version_select at 0x7f47648a24c0>, body: {"keypair": {"name": "tempest-keypair-2112116052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEytBNyACFi68MM0HcdWSqRU3WFwm4X3quin2xSFZg0lRX35IOqvBXq1lNnuSQqGwkSpgjd9J8zPIznYIODZE8kgKTXluBfZ7Mz0YX5bRjg53WMK+YCKhLagyKZdhhnjeA=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:56.466475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57353522-89cb-4f1e-9fc5-530dd490f5c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for project 9bc18901e30b4252988c065baa36be3c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:45:56.470715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57353522-89cb-4f1e-9fc5-530dd490f5c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for user b5040520134e464ea1d534767ea8728e and project 9bc18901e30b4252988c065baa36be3c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:45:56.497222 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57353522-89cb-4f1e-9fc5-530dd490f5c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049272 Jul 01 19:45:56.498067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 429/850] 10.222.0.61 () {62 vars in 1199 bytes} [Fri Jul 1 19:45:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 19:45:57.024109 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:57.024713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:57.031576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:57.032153 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:57.032956 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:57.033393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:57.167334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:57.174738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6498f651-6c99-4cd0-8f14-ce13448a10ec tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.154820 Jul 01 19:45:57.175301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 422/851] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:57 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:57.754228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-866960822", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceceb8fb-a9de-4f75-b2ed-1847f781916d"}], "security_groups": [{"name": "tempest-securitygroup--276942198"}], "key_name": "tempest-keypair-2112116052", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:57.861278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] validate_networks() for [('ceceb8fb-a9de-4f75-b2ed-1847f781916d', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:45:58.191837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:58.192344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:58.199386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:58.199835 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:58.200601 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:58.201038 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:58.288281 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:45:58.288707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:45:58.289297 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:45:58.289656 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:45:58.290068 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:45:58.316151 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:58.316643 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:58.317438 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:58.318128 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:58.338854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for project 9bc18901e30b4252988c065baa36be3c. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:45:58.340643 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:58.345238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Getting quotas for user b5040520134e464ea1d534767ea8728e and project 9bc18901e30b4252988c065baa36be3c. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:45:58.360277 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:45:58.360657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:58.362906 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:45:58.370062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e13d9284-a41f-490c-9f70-9f7db40274ff tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1367 microversion: 2.1 time: 0.182253 Jul 01 19:45:58.370653 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 423/852] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:58 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:58.410941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-21569887-6f32-4bfd-bbef-c08ecde93278 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.661589 Jul 01 19:45:58.411949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 430/853] 10.222.0.61 () {62 vars in 1187 bytes} [Fri Jul 1 19:45:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 19:45:58.421914 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dd31b19c-c967-472c-9f76-53a022bcfa16 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:58.422621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dd31b19c-c967-472c-9f76-53a022bcfa16 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:58.482780 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dd31b19c-c967-472c-9f76-53a022bcfa16 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:58.491525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dd31b19c-c967-472c-9f76-53a022bcfa16 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:58.493016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dd31b19c-c967-472c-9f76-53a022bcfa16 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:58.494184 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dd31b19c-c967-472c-9f76-53a022bcfa16 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1281 microversion: 2.20 time: 0.076208 Jul 01 19:45:58.494738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 424/854] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:58 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:59.389177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:59.389832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:59.396994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:59.397444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:59.398243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:59.398697 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:59.514016 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:59.514640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:59.522142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:59.522579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:59.523382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:59.524516 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:59.533727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:59.541698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-84418414-7653-4fda-8fb2-85590cec25cc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1557 microversion: 2.1 time: 0.157244 Jul 01 19:45:59.542536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 431/855] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:45:59 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:59.559234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:59.559729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:45:59.566002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:59.566454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:59.567228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:45:59.567662 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:45:59.603431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:59.613237 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:59.615044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:45:59.616332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a78c2080-816e-45b0-bafb-6613fa879325 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1341 microversion: 2.20 time: 0.107559 Jul 01 19:45:59.616894 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 425/856] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:45:59 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1341 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:59.704309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-29b748b4-9672-42da-8e39-a369ce8d360f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148237 Jul 01 19:45:59.705193 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 432/857] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:45:59 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:46:00.639309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-958f2ec6-bc46-429a-9cb7-b0f78311600f req-0348556d-c252-4c60-ad4e-fbfd599b5c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be86e9b5-d5ca-4775-ba1b-041e6031db62", "tag": "a59df434-bb84-4057-859f-34ae4a4f55d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:00.645222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:00.645839 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:00.659731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:00.660371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:00.661263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:00.661758 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:00.662390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-958f2ec6-bc46-429a-9cb7-b0f78311600f req-0348556d-c252-4c60-ad4e-fbfd599b5c75 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:00.662855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-958f2ec6-bc46-429a-9cb7-b0f78311600f req-0348556d-c252-4c60-ad4e-fbfd599b5c75 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:00.688146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-958f2ec6-bc46-429a-9cb7-b0f78311600f req-0348556d-c252-4c60-ad4e-fbfd599b5c75 service nova] Creating event network-changed:a59df434-bb84-4057-859f-34ae4a4f55d6 for instance be86e9b5-d5ca-4775-ba1b-041e6031db62 on hv-cinder-83124 Jul 01 19:46:00.699687 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-958f2ec6-bc46-429a-9cb7-b0f78311600f req-0348556d-c252-4c60-ad4e-fbfd599b5c75 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064453 Jul 01 19:46:00.706100 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 433/858] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:00.920531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:00.937201 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:00.944711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:00.947393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3bc8e138-2bc5-4a4f-9598-7e5fb82582aa tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.315279 Jul 01 19:46:00.950065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 426/859] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:00 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:01.428955 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-490f0535-3872-45b6-8586-87bdc2d00413 req-e875eca2-a64d-4d8a-a84c-52ec6beafb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:01.444719 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-490f0535-3872-45b6-8586-87bdc2d00413 req-e875eca2-a64d-4d8a-a84c-52ec6beafb03 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:01.445361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-490f0535-3872-45b6-8586-87bdc2d00413 req-e875eca2-a64d-4d8a-a84c-52ec6beafb03 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:01.463422 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-490f0535-3872-45b6-8586-87bdc2d00413 req-e875eca2-a64d-4d8a-a84c-52ec6beafb03 service nova] Creating event network-changed:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:46:01.468648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-490f0535-3872-45b6-8586-87bdc2d00413 req-e875eca2-a64d-4d8a-a84c-52ec6beafb03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044829 Jul 01 19:46:01.469261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 434/860] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:01.967672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:01.968325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:01.975456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:01.975978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:01.976766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:01.977218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:02.115465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:02.128242 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:02.130700 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:02.132260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ff22bb50-c89e-4840-8f93-09e0d4cc5005 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.168393 Jul 01 19:46:02.133010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 427/861] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:01 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:03.155211 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:03.155907 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:03.163258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:03.163712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:03.164506 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:03.164939 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:03.305182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:03.317660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:03.319798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:03.321822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-92e008fd-96c3-404a-bd57-05f5a62784fe tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.170368 Jul 01 19:46:03.322637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 435/862] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:03 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:04.345640 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:04.346677 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:04.354524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:04.354968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:04.355721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:04.356148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:04.488182 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:04.500584 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:04.503089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:04.504940 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0a276ac0-695e-41df-a1db-77495a744562 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.166710 Jul 01 19:46:04.505561 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 428/863] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:04 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:05.526345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:05.527091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:05.535142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:05.535730 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:05.536671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:05.537295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:05.677168 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:05.685617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:05.687036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:05.688187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d830bb56-bb01-4b6b-8f32-f47e94c9a636 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.167869 Jul 01 19:46:05.688902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 436/864] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:05 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:06.711443 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:06.712413 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:06.723456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:06.723910 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:06.724674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:06.725107 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:06.869786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:06.877776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:06.879293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:06.880621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-415d104a-c208-4f97-8d12-7216771fc95b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.175854 Jul 01 19:46:06.881180 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 429/865] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:06 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:07.808881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d7f478c7-231a-4660-bfdf-a86072f9068c req-dea5eaf0-cc0a-4e3e-8dd0-871f2a43f8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "name": "network-vif-plugged", "status": "completed", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:07.818111 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d7f478c7-231a-4660-bfdf-a86072f9068c req-dea5eaf0-cc0a-4e3e-8dd0-871f2a43f8e0 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:07.818694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d7f478c7-231a-4660-bfdf-a86072f9068c req-dea5eaf0-cc0a-4e3e-8dd0-871f2a43f8e0 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:07.830680 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d7f478c7-231a-4660-bfdf-a86072f9068c req-dea5eaf0-cc0a-4e3e-8dd0-871f2a43f8e0 service nova] Creating event network-vif-plugged:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:46:07.835604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d7f478c7-231a-4660-bfdf-a86072f9068c req-dea5eaf0-cc0a-4e3e-8dd0-871f2a43f8e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030396 Jul 01 19:46:07.836187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 437/866] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:07.899839 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:07.900365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:07.907806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:07.908254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:07.909014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:07.909449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:08.050840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:08.063286 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:08.064786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:08.065901 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-826fc629-62fd-40e9-b7d0-9ce20b6c28a3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.170104 Jul 01 19:46:08.066480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 430/867] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:07 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:09.081784 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:09.082587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:09.087742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:09.088437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:09.095571 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:09.096022 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:09.096780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:09.097217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:09.248703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:09.260355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:09.262775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:09.264483 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ac22c392-bf5b-4a22-8e28-c59b98162be8 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1406 microversion: 2.20 time: 0.183403 Jul 01 19:46:09.265182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 438/868] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:09 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:10.289922 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:10.291027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:10.296176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:10.297306 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:10.306564 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:10.307037 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:10.307817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:10.308252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:10.452515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:10.464505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:10.466867 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:10.468298 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3cd56592-00d8-46dd-bc97-46be90687bdd tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1597 microversion: 2.20 time: 0.185362 Jul 01 19:46:10.469051 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 431/869] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:46:10 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1597 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:10.487412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:10.488005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:10.495264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:10.495710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:10.496490 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:10.496925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:10.585706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f858ec2d-3940-4a33-8bf0-988e5d9bf606 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102197 Jul 01 19:46:10.586364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 439/870] 10.222.0.61 () {60 vars in 1315 bytes} [Fri Jul 1 19:46:10 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:46:11.768562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-e9710476-fa82-4e8b-8483-8df948eff6a0 req-7356653d-b6cd-4f40-8eda-07fe0062cf58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:11.777519 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e9710476-fa82-4e8b-8483-8df948eff6a0 req-7356653d-b6cd-4f40-8eda-07fe0062cf58 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:11.777976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e9710476-fa82-4e8b-8483-8df948eff6a0 req-7356653d-b6cd-4f40-8eda-07fe0062cf58 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:11.789294 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-e9710476-fa82-4e8b-8483-8df948eff6a0 req-7356653d-b6cd-4f40-8eda-07fe0062cf58 service nova] Creating event network-changed:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:46:11.794464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-e9710476-fa82-4e8b-8483-8df948eff6a0 req-7356653d-b6cd-4f40-8eda-07fe0062cf58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029537 Jul 01 19:46:11.795073 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 432/871] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:12.012914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:12.014069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:12.021426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:12.021894 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:12.022710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:12.023146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:12.112673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lazy-loading 'services' on Instance uuid 107094b7-ca95-4b66-b984-2359f2ef2a51 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:46:12.195055 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0d4de6bc-3b2f-4fed-8ec2-13272f13aabb tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments/1681ada2-f95a-4909-ae02-90049613ec61" status: 202 len: 0 microversion: 2.1 time: 0.185871 Jul 01 19:46:12.199179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 440/872] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:46:12 2022] DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments/1681ada2-f95a-4909-ae02-90049613ec61 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:46:12.205044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:12.206249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:12.215382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:12.215998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:12.217165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:12.217977 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:12.255187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ad324273-de44-4ba5-963d-315a1e4505a5 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054329 Jul 01 19:46:12.255959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 433/873] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:46:12 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:13.268333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:13.269400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:13.277492 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:13.277912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:13.278737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:13.279168 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:13.310704 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-38ea685e-b4dc-47dd-aa36-059e6059d6af tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047183 Jul 01 19:46:13.311270 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 441/874] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:46:13 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:46:13.385172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:13.385704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:13.392507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:13.392933 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:13.394044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:13.394479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:13.426503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:46:13.512282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-088aad96-b8ac-4fa3-9678-7bae5370ae39 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 204 len: 0 microversion: 2.1 time: 0.130647 Jul 01 19:46:13.512776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 434/875] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:46:13 2022] DELETE /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:46:13.521761 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:13.522461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:13.529566 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:13.530011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:13.531048 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:13.531659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:13.660260 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:13.668285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ae0a73c1-168c-4613-8a52-8fba405fa9c7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1691 microversion: 2.1 time: 0.150864 Jul 01 19:46:13.668886 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 442/876] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:13 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:46:14.690679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:14.691801 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:14.703529 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:14.704283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:14.705552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:14.706343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:14.857222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:14.864976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-27329199-db0f-412a-b5fc-63d3587b16d7 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1691 microversion: 2.1 time: 0.181568 Jul 01 19:46:14.865542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 435/877] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:14 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:15.885169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:15.886042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:15.895746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:15.896391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:15.897476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:15.898137 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:16.037903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:16.047931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d469ae0c-0730-4fad-be10-5f2355d731da tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1691 microversion: 2.1 time: 0.168406 Jul 01 19:46:16.048505 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 443/878] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:15 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:17.069878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:17.070504 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:17.077803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:17.078283 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:17.079033 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:17.079448 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:17.213784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:17.221468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c36c6f96-e7fa-42c8-9b90-521877aa1d0d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1691 microversion: 2.1 time: 0.157509 Jul 01 19:46:17.222194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 436/879] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:17 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:18.240622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:18.241465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:18.248123 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:18.248579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:18.249395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:18.249782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:18.490596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:18.498341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c31f39d-032e-4dd2-bcd0-908786722910 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 200 len: 1691 microversion: 2.1 time: 0.263063 Jul 01 19:46:18.499043 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 444/880] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:18 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:18.671342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-2a5ad75e-f561-4fa2-87f5-e247586aa691 req-abc16915-11f4-4b87-ba5b-4c1cb578354b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107094b7-ca95-4b66-b984-2359f2ef2a51", "name": "network-vif-deleted", "tag": "7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:18.682655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-2a5ad75e-f561-4fa2-87f5-e247586aa691 req-abc16915-11f4-4b87-ba5b-4c1cb578354b service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:18.683117 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-2a5ad75e-f561-4fa2-87f5-e247586aa691 req-abc16915-11f4-4b87-ba5b-4c1cb578354b service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:18.687903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:18.697272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-2a5ad75e-f561-4fa2-87f5-e247586aa691 req-abc16915-11f4-4b87-ba5b-4c1cb578354b service nova] Creating event network-vif-deleted:7ef388b4-f1af-41bf-8f4e-1ba2e3a61d12 for instance 107094b7-ca95-4b66-b984-2359f2ef2a51 on hv-cinder-83124 Jul 01 19:46:18.703255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-2a5ad75e-f561-4fa2-87f5-e247586aa691 req-abc16915-11f4-4b87-ba5b-4c1cb578354b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035561 Jul 01 19:46:18.706967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 437/881] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:19.516191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:19.516799 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 107094b7-ca95-4b66-b984-2359f2ef2a51] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:19.524430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:19.524878 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:19.525674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:19.526103 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:19.541992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] HTTP exception thrown: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 could not be found. Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Request method failure captured: Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 HTTP/1.1 Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv002nx8fsanozFIk_k9JzkgEqUOE9MB3q4Lv6Te5dr16vSvMXmyEulASNznKW0X1Yo2TxPfZZaeHYdqdGlmS9vxnvSitealY4CfvTbjF-k5_qO9rOhW0pPOMnYPmYoQsUkoPz01VhB_IirGGMzYdIOgTSTL5XXVIPhuRYZa6H8TmtnY Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:46:19.543698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd397adb95a6455b8e78db9b132d865e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: bf5ff69a857f412fb65dce1b59a22e9d Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 could not be found. Jul 01 19:46:19.545242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '107094b7-ca95-4b66-b984-2359f2ef2a51'} Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 could not be found. Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:19.546202 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 could not be found. Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 could not be found. Jul 01 19:46:19.547600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:19.548864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Returning 404 to user: Instance 107094b7-ca95-4b66-b984-2359f2ef2a51 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:19.548864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e052ff62-0b1a-4a7f-80af-7ea78b138d04 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51" status: 404 len: 111 microversion: 2.1 time: 0.033270 Jul 01 19:46:19.549114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 445/882] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:19 2022] GET /compute/v2.1/servers/107094b7-ca95-4b66-b984-2359f2ef2a51 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:46:19.555131 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0e395ce3-3e35-4b0d-90f0-9c1313a074b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '.version_select at 0x7f4764829ca0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:19.574893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0e395ce3-3e35-4b0d-90f0-9c1313a074b3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391804274" status: 202 len: 0 microversion: 2.1 time: 0.024064 Jul 01 19:46:19.575577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 438/883] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jul 1 19:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391804274 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:46:22.483758 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:22.484255 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:22.491044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:22.491494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:22.492256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:22.492695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:22.519637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:46:22.600366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c9a504e5-962f-44c0-812f-c9c734e20df3 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 204 len: 0 microversion: 2.1 time: 0.120202 Jul 01 19:46:22.601291 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 446/884] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:46:22 2022] DELETE /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:46:22.610142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:22.611012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:22.617435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:22.618056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:22.618829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:22.619263 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:22.763027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:22.771340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2064164a-ce6f-412a-b392-e25b8d0b6873 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1505 microversion: 2.1 time: 0.166057 Jul 01 19:46:22.771919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 439/885] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:22 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:23.789392 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:23.790452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:23.799051 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:23.799625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:23.800740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:23.803144 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:23.808663 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:24.022829 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:24.030843 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f5b18e81-5adb-4eb2-ab46-f96d4178ac0a tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 200 len: 1505 microversion: 2.1 time: 0.245941 Jul 01 19:46:24.031391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 447/886] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:23 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:24.242194 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-13064fdb-7aa3-4b37-b5d1-ba3235981ebc req-e04450ef-a7d6-47d7-8cc8-bb822d968b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c757bfe-0ddd-4359-bde1-69dedd1a8fbf", "name": "network-vif-deleted", "tag": "f799a0e5-d0ef-4240-a5d6-057c692e1daf"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:24.250997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-13064fdb-7aa3-4b37-b5d1-ba3235981ebc req-e04450ef-a7d6-47d7-8cc8-bb822d968b8d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:24.251472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-13064fdb-7aa3-4b37-b5d1-ba3235981ebc req-e04450ef-a7d6-47d7-8cc8-bb822d968b8d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:24.262884 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-13064fdb-7aa3-4b37-b5d1-ba3235981ebc req-e04450ef-a7d6-47d7-8cc8-bb822d968b8d service nova] Creating event network-vif-deleted:f799a0e5-d0ef-4240-a5d6-057c692e1daf for instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf on hv-cinder-83124 Jul 01 19:46:24.267883 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-13064fdb-7aa3-4b37-b5d1-ba3235981ebc req-e04450ef-a7d6-47d7-8cc8-bb822d968b8d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029438 Jul 01 19:46:24.268891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 440/887] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:25.052351 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.054442 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:25.061852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:25.062561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:25.063020 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:25.063456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:25.077613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] HTTP exception thrown: Instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf could not be found. Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Request method failure captured: Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf HTTP/1.1 Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv002nx8fsanozFIk_k9JzkgEqUOE9MB3q4Lv6Te5dr16vSvMXmyEulASNznKW0X1Yo2TxPfZZaeHYdqdGlmS9vxnvSitealY4CfvTbjF-k5_qO9rOhW0pPOMnYPmYoQsUkoPz01VhB_IirGGMzYdIOgTSTL5XXVIPhuRYZa6H8TmtnY Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:46:25.079315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd397adb95a6455b8e78db9b132d865e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: bf5ff69a857f412fb65dce1b59a22e9d Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf could not be found. Jul 01 19:46:25.080669 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '6c757bfe-0ddd-4359-bde1-69dedd1a8fbf'} Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf could not be found. Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:25.081631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf could not be found. Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf could not be found. Jul 01 19:46:25.083163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.084503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Returning 404 to user: Instance 6c757bfe-0ddd-4359-bde1-69dedd1a8fbf could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:25.084503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f843e2ef-5e07-40fa-ab52-e0b86d7121b8 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf" status: 404 len: 111 microversion: 2.1 time: 0.035286 Jul 01 19:46:25.084503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 448/888] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:25 2022] GET /compute/v2.1/servers/6c757bfe-0ddd-4359-bde1-69dedd1a8fbf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:46:25.090222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.090811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:25.097424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:25.097875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:25.098672 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:25.099108 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:25.124702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:46:25.207773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-68d8018d-6347-4d5f-88fd-398581e8c86f tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "DELETE /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 204 len: 0 microversion: 2.1 time: 0.121685 Jul 01 19:46:25.208422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 441/889] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:46:25 2022] DELETE /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:46:25.217448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.218102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:25.224924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:25.226110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:25.227276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:25.227276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:25.365832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:25.374060 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bb06bc14-be38-4df7-8307-e942381e1404 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.160428 Jul 01 19:46:25.374605 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 449/890] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:25 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:26.391574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:26.392282 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:26.399196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:26.399646 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:26.400454 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:26.400891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:26.612374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5ff69a857f412fb65dce1b59a22e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd397adb95a6455b8e78db9b132d865e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:26.620507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1866d72b-4e9b-4322-b558-0244b1b21d6d tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 200 len: 1522 microversion: 2.1 time: 0.233299 Jul 01 19:46:26.621045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 442/891] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:26 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:26.787721 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-95c1b210-13e3-4753-af79-4ee8e5b2cbdd req-14bd33d4-57e2-439b-bb87-cf212d74c067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061b75be-e4ba-4cb7-b74a-3373e5495283", "name": "network-vif-deleted", "tag": "401375fd-18a5-4ae1-9ec2-8794947f178c"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:26.796430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-95c1b210-13e3-4753-af79-4ee8e5b2cbdd req-14bd33d4-57e2-439b-bb87-cf212d74c067 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:26.796882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-95c1b210-13e3-4753-af79-4ee8e5b2cbdd req-14bd33d4-57e2-439b-bb87-cf212d74c067 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:26.807872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-95c1b210-13e3-4753-af79-4ee8e5b2cbdd req-14bd33d4-57e2-439b-bb87-cf212d74c067 service nova] Creating event network-vif-deleted:401375fd-18a5-4ae1-9ec2-8794947f178c for instance 061b75be-e4ba-4cb7-b74a-3373e5495283 on hv-cinder-83124 Jul 01 19:46:26.812539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-95c1b210-13e3-4753-af79-4ee8e5b2cbdd req-14bd33d4-57e2-439b-bb87-cf212d74c067 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028552 Jul 01 19:46:26.813290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 450/892] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:27.637253 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:27.637967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] [instance: 061b75be-e4ba-4cb7-b74a-3373e5495283] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:27.645492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:27.646145 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:27.646934 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:27.647405 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:27.662287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] HTTP exception thrown: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 could not be found. Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Request method failure captured: Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 HTTP/1.1 Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv002nx8fsanozFIk_k9JzkgEqUOE9MB3q4Lv6Te5dr16vSvMXmyEulASNznKW0X1Yo2TxPfZZaeHYdqdGlmS9vxnvSitealY4CfvTbjF-k5_qO9rOhW0pPOMnYPmYoQsUkoPz01VhB_IirGGMzYdIOgTSTL5XXVIPhuRYZa6H8TmtnY Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:46:27.663990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bd397adb95a6455b8e78db9b132d865e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bd397adb95a6455b8e78db9b132d865e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: bd397adb95a6455b8e78db9b132d865e Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-938382232 Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: bf5ff69a857f412fb65dce1b59a22e9d Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-938382232-project Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 could not be found. Jul 01 19:46:27.665583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '061b75be-e4ba-4cb7-b74a-3373e5495283'} Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 could not be found. Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:27.666536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 could not be found. Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 could not be found. Jul 01 19:46:27.667929 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.669236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] Returning 404 to user: Instance 061b75be-e4ba-4cb7-b74a-3373e5495283 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:27.669236 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6af121a1-6f2c-432c-8424-9c8ee9fba0f1 tempest-ServerRescueNegativeTestJSON-938382232 tempest-ServerRescueNegativeTestJSON-938382232-project] 10.222.0.61 "GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283" status: 404 len: 111 microversion: 2.1 time: 0.032345 Jul 01 19:46:27.669791 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 443/893] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:27 2022] GET /compute/v2.1/servers/061b75be-e4ba-4cb7-b74a-3373e5495283 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:46:32.398940 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0a2fa1ec-888d-4f07-820f-7db0da3f9716 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Action: 'create', calling method: .version_select at 0x7f47647b3e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1738093951", "metadata": {"Type": "work"}}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0a2fa1ec-888d-4f07-820f-7db0da3f9716 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Request method failure captured: Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 122 Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv08YWJYuvoBAyeZiSN6x9fJy2b1P4dV8rU5cyqucNmJNLlPDdxbyFzL7bKbmB2l5a_OETvfaS4xJLptv7RAhIa3J9ceqyAbqSn9_yPgdfKzvE4safzThR7s7-acEEwS-qtu9HBCil8wGZ9InxNnzLtzrcPR-d14W_AFR9fBmATQlKHw Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:46:32.425489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98c960f00ca549bb9a649b9d1374a69b", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 9dcd619f7c4341479f27831ce0887f0f Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1738093951", "metadata": {"Type": "work"}}} Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: Jul 01 19:46:32.426952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1738093951', 'metadata': {'Type': 'work'}}}} Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise error Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi '#$%' Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:32.427875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 19:46:32.429167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 19:46:32.431741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 19:46:32.431741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.431741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0a2fa1ec-888d-4f07-820f-7db0da3f9716 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:32.431741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0a2fa1ec-888d-4f07-820f-7db0da3f9716 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151033 Jul 01 19:46:32.431741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 451/894] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jul 1 19:46:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:46:32.436916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93237119-4de5-48a8-94e3-0e92931f1f60 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Action: 'create', calling method: .version_select at 0x7f47646fee50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-850028659", "metadata": {"Type": "work"}}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93237119-4de5-48a8-94e3-0e92931f1f60 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Request method failure captured: Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 119 Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv08YWJYuvoBAyeZiSN6x9fJy2b1P4dV8rU5cyqucNmJNLlPDdxbyFzL7bKbmB2l5a_OETvfaS4xJLptv7RAhIa3J9ceqyAbqSn9_yPgdfKzvE4safzThR7s7-acEEwS-qtu9HBCil8wGZ9InxNnzLtzrcPR-d14W_AFR9fBmATQlKHw Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:46:32.440149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98c960f00ca549bb9a649b9d1374a69b", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 9dcd619f7c4341479f27831ce0887f0f Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-850028659", "metadata": {"Type": "work"}}} Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:46:32.441579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-850028659', 'metadata': {'Type': 'work'}}}} Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise error Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi '0' Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:32.442668 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 19:46:32.444171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 19:46:32.446273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 19:46:32.446273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.446273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93237119-4de5-48a8-94e3-0e92931f1f60 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:32.446273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-93237119-4de5-48a8-94e3-0e92931f1f60 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008482 Jul 01 19:46:32.446273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 444/895] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jul 1 19:46:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:46:32.451058 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5df37e61-193f-4ad9-bc13-da9cc1b72cf7 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Action: 'create', calling method: .version_select at 0x7f476471c5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2008546316", "metadata": {"Type": "work"}}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5df37e61-193f-4ad9-bc13-da9cc1b72cf7 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Request method failure captured: Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 119 Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv08YWJYuvoBAyeZiSN6x9fJy2b1P4dV8rU5cyqucNmJNLlPDdxbyFzL7bKbmB2l5a_OETvfaS4xJLptv7RAhIa3J9ceqyAbqSn9_yPgdfKzvE4safzThR7s7-acEEwS-qtu9HBCil8wGZ9InxNnzLtzrcPR-d14W_AFR9fBmATQlKHw Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:46:32.453376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98c960f00ca549bb9a649b9d1374a69b", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 9dcd619f7c4341479f27831ce0887f0f Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2008546316", "metadata": {"Type": "work"}}} Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: Jul 01 19:46:32.454936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2008546316', 'metadata': {'Type': 'work'}}}} Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise error Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi '' Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:32.456005 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 19:46:32.457512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 19:46:32.458783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 19:46:32.458783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.458783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5df37e61-193f-4ad9-bc13-da9cc1b72cf7 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:32.458783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5df37e61-193f-4ad9-bc13-da9cc1b72cf7 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007517 Jul 01 19:46:32.458783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 452/896] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Jul 1 19:46:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:46:32.464095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9b69722a-dc7a-4b94-918b-41e0104d4891 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Calling method '.version_select at 0x7f47648983a0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:32.493502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-9b69722a-dc7a-4b94-918b-41e0104d4891 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] HTTP exception thrown: Volume tempest-invalid-649972772 could not be found. Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9b69722a-dc7a-4b94-918b-41e0104d4891 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Request method failure captured: Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-649972772 HTTP/1.1 Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv08YWJYuvoBAyeZiSN6x9fJy2b1P4dV8rU5cyqucNmJNLlPDdxbyFzL7bKbmB2l5a_OETvfaS4xJLptv7RAhIa3J9ceqyAbqSn9_yPgdfKzvE4safzThR7s7-acEEwS-qtu9HBCil8wGZ9InxNnzLtzrcPR-d14W_AFR9fBmATQlKHw Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:46:32.495535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98c960f00ca549bb9a649b9d1374a69b", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 9dcd619f7c4341479f27831ce0887f0f Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Volume tempest-invalid-649972772 could not be found. Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'tempest-invalid-649972772'} Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:32.497095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-649972772 could not be found. (HTTP 404) (Request-ID: req-2abbaa78-ed92-4bc5-9086-43f258d6c5d6) Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.498026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:46:32.499148 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-649972772 could not be found. Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:32.500191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-649972772 could not be found. Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-649972772 could not be found. Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9b69722a-dc7a-4b94-918b-41e0104d4891 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Returning 404 to user: Volume tempest-invalid-649972772 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9b69722a-dc7a-4b94-918b-41e0104d4891 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-649972772" status: 404 len: 98 microversion: 2.1 time: 0.037089 Jul 01 19:46:32.501318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 445/897] 10.222.0.61 () {58 vars in 1214 bytes} [Fri Jul 1 19:46:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-649972772 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 19:46:32.507307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-38531664-f926-4448-a75f-ea8143f43107 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003759 Jul 01 19:46:32.507799 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 453/898] 10.222.0.61 () {58 vars in 1139 bytes} [Fri Jul 1 19:46:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 19:46:32.515953 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1141169a-5445-4856-bd9b-24cf795b1e28 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003683 Jul 01 19:46:32.516461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 446/899] 10.222.0.61 () {58 vars in 1136 bytes} [Fri Jul 1 19:46:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 19:46:32.524744 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12384fcf-4133-4b65-968d-344d57ae4a8c tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Calling method '.version_select at 0x7f476471c820>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:32.561928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-12384fcf-4133-4b65-968d-344d57ae4a8c tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] HTTP exception thrown: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12384fcf-4133-4b65-968d-344d57ae4a8c tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Request method failure captured: Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/os-volumes/3a919b2d-39fe-4c7a-95e1-edf32acac38a HTTP/1.1 Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv08YWJYuvoBAyeZiSN6x9fJy2b1P4dV8rU5cyqucNmJNLlPDdxbyFzL7bKbmB2l5a_OETvfaS4xJLptv7RAhIa3J9ceqyAbqSn9_yPgdfKzvE4safzThR7s7-acEEwS-qtu9HBCil8wGZ9InxNnzLtzrcPR-d14W_AFR9fBmATQlKHw Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:46:32.565383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98c960f00ca549bb9a649b9d1374a69b", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 9dcd619f7c4341479f27831ce0887f0f Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '3a919b2d-39fe-4c7a-95e1-edf32acac38a'} Jul 01 19:46:32.566802 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. (HTTP 404) (Request-ID: req-c0d1df22-7696-4a7e-a9b6-4c8a228efc61) Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.567586 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:46:32.568728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 19:46:32.569818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12384fcf-4133-4b65-968d-344d57ae4a8c tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Returning 404 to user: Volume 3a919b2d-39fe-4c7a-95e1-edf32acac38a could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-12384fcf-4133-4b65-968d-344d57ae4a8c tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/3a919b2d-39fe-4c7a-95e1-edf32acac38a" status: 404 len: 109 microversion: 2.1 time: 0.045685 Jul 01 19:46:32.571393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 454/900] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:46:32 2022] DELETE /compute/v2.1/os-volumes/3a919b2d-39fe-4c7a-95e1-edf32acac38a => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:46:32.577055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb48b17d-5bb8-477b-90bd-9999fa59aee4 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Calling method '.version_select at 0x7f4764829040>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:32.609353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-bb48b17d-5bb8-477b-90bd-9999fa59aee4 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] HTTP exception thrown: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb48b17d-5bb8-477b-90bd-9999fa59aee4 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Request method failure captured: Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/os-volumes/558ef906-6e98-4275-b9c8-0c84cf51f7d5 HTTP/1.1 Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv08YWJYuvoBAyeZiSN6x9fJy2b1P4dV8rU5cyqucNmJNLlPDdxbyFzL7bKbmB2l5a_OETvfaS4xJLptv7RAhIa3J9ceqyAbqSn9_yPgdfKzvE4safzThR7s7-acEEwS-qtu9HBCil8wGZ9InxNnzLtzrcPR-d14W_AFR9fBmATQlKHw Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:46:32.611323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98c960f00ca549bb9a649b9d1374a69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98c960f00ca549bb9a649b9d1374a69b", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 98c960f00ca549bb9a649b9d1374a69b Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-69450753 Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 9dcd619f7c4341479f27831ce0887f0f Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-69450753-project Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '558ef906-6e98-4275-b9c8-0c84cf51f7d5'} Jul 01 19:46:32.612916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. (HTTP 404) (Request-ID: req-74e48a83-be60-4b57-8585-9c752562849c) Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.613872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:46:32.615390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:46:32.617127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb48b17d-5bb8-477b-90bd-9999fa59aee4 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] Returning 404 to user: Volume 558ef906-6e98-4275-b9c8-0c84cf51f7d5 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb48b17d-5bb8-477b-90bd-9999fa59aee4 tempest-VolumesNegativeTest-69450753 tempest-VolumesNegativeTest-69450753-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/558ef906-6e98-4275-b9c8-0c84cf51f7d5" status: 404 len: 109 microversion: 2.1 time: 0.039524 Jul 01 19:46:32.618492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 447/901] 10.222.0.61 () {58 vars in 1244 bytes} [Fri Jul 1 19:46:32 2022] GET /compute/v2.1/os-volumes/558ef906-6e98-4275-b9c8-0c84cf51f7d5 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:46:42.772011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:42.772774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=15 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:42.777233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:42.778353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:42.786621 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:42.787067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:42.787833 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:42.788274 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:42.818458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5adad62e-d18f-4873-beef-46896c90bcf0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047788 Jul 01 19:46:42.819009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 455/902] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:46:42 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:46:42.875739 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:42.876498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:42.881518 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:42.882037 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:42.889701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:42.890168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:42.890958 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:42.891532 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:42.918476 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:46:43.000354 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f838a90d-7fd3-4e82-a0b1-430bb2313824 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 204 len: 0 microversion: 2.1 time: 0.125736 Jul 01 19:46:43.000891 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 448/903] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:46:42 2022] DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:46:43.011297 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:43.012013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:43.018269 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:43.018727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:43.019494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:43.019929 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:43.155703 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:43.163430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d939f798-fe28-4c79-b0ec-3882be1501e4 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1674 microversion: 2.1 time: 0.157699 Jul 01 19:46:43.163994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 456/904] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:43 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:46:44.183606 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:44.184508 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:44.193367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:44.193987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:44.195011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:44.195583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:44.336386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:44.344147 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ffe4c638-0425-4d4e-9c8c-639d50eb1643 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1674 microversion: 2.1 time: 0.166264 Jul 01 19:46:44.344703 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 449/905] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:44 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:45.363299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:45.364000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:45.371965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:45.372415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:45.373176 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:45.373607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:45.461903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:45.469970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3936cd63-6573-4a61-9716-04ab443f72d0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 200 len: 1606 microversion: 2.1 time: 0.112535 Jul 01 19:46:45.478573 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 457/906] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:45 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 1606 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:45.566132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-ef296ee8-b6de-498a-a5a3-2405a774984a req-5b6aebfe-63db-42b7-871f-9d771a01d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd8c337-77a5-4fd0-aeef-555fb1ad2d13", "name": "network-vif-deleted", "tag": "3e673c64-9dd5-4928-8b69-9216037d8dde"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:45.584238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ef296ee8-b6de-498a-a5a3-2405a774984a req-5b6aebfe-63db-42b7-871f-9d771a01d1ba service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:45.585512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ef296ee8-b6de-498a-a5a3-2405a774984a req-5b6aebfe-63db-42b7-871f-9d771a01d1ba service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:45.598334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-ef296ee8-b6de-498a-a5a3-2405a774984a req-5b6aebfe-63db-42b7-871f-9d771a01d1ba service nova] Creating event network-vif-deleted:3e673c64-9dd5-4928-8b69-9216037d8dde for instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 on hv-cinder-83124 Jul 01 19:46:45.609365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-ef296ee8-b6de-498a-a5a3-2405a774984a req-5b6aebfe-63db-42b7-871f-9d771a01d1ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053824 Jul 01 19:46:45.610345 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 450/907] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:46.487789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:46.489086 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:46.495828 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:46.496198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:46.497170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:46.497611 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:46.511919 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] HTTP exception thrown: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Request method failure captured: Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 HTTP/1.1 Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000JEXxyg8F8K4SmNfRGrhY4P96k1ssR1CNTDaN8egsAy1U43YbyZBevlL350QI9GSxOPwsMV74LzkZr8mCF_xj7TecUsYKgMGJdwAYZws3eZZvmgrCmSFcqyu897kfE0qJ-B5nQQq_0sHfN2tN8vbmtzkcsnaa7t7ADN7HVUfCQWw Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 21155f0418884af191e3e7981904730c Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:46:46.513752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21155f0418884af191e3e7981904730c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21155f0418884af191e3e7981904730c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 21155f0418884af191e3e7981904730c Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: c4167eeb95ca4a95a7db1c8e2491a411 Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:46:46.515395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'acd8c337-77a5-4fd0-aeef-555fb1ad2d13'} Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:46.516182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:46:46.517441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:46:46.519874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Returning 404 to user: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:46.521042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4cac175a-e61b-4255-93c8-f4b4f6cb9535 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 404 len: 111 microversion: 2.1 time: 0.037052 Jul 01 19:46:46.521489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 458/908] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:46 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:46:46.530600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-03c3312c-84e4-4884-819a-673fe6984f31 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '.version_select at 0x7f47646acaf0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:46.549837 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-03c3312c-84e4-4884-819a-673fe6984f31 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220373568" status: 202 len: 0 microversion: 2.1 time: 0.023502 Jul 01 19:46:46.550922 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 451/909] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jul 1 19:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220373568 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:46:47.391253 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-98245115-ad25-48fe-8cd2-b9dc10a98d2d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: .version_select at 0x7f476473f3a0>, body: {"keypair": {"name": "tempest-keypair-1050256279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAJYjSYZGwKj246UBjvd5iIRmBzNG7pBgecSWSKv7ED2A4Y/1vtvcfRg1IsfGzWmWa/noJ9KRJFKmvUYbMTD/BDSJrAmaRd5AbEcEhMXHmJTVXRniw/OPj6Vn6PMRd88A=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:47.407581 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-98245115-ad25-48fe-8cd2-b9dc10a98d2d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for project 21155f0418884af191e3e7981904730c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:46:47.411674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-98245115-ad25-48fe-8cd2-b9dc10a98d2d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for user c4167eeb95ca4a95a7db1c8e2491a411 and project 21155f0418884af191e3e7981904730c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:46:47.435389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-98245115-ad25-48fe-8cd2-b9dc10a98d2d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051646 Jul 01 19:46:47.436034 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 459/910] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:46:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:48.790615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-125920492", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b6a6bb7-8e95-46ce-aeac-814f0f95c869"}], "security_groups": [{"name": "tempest-securitygroup--288652510"}], "key_name": "tempest-keypair-1050256279", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:48.892522 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] validate_networks() for [('2b6a6bb7-8e95-46ce-aeac-814f0f95c869', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:46:49.266630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:46:49.267121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:46:49.267657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:46:49.268067 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:46:49.268481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:46:49.277507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:49.278056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:49.278956 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:49.279459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:49.296079 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for project 21155f0418884af191e3e7981904730c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:46:49.300044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Getting quotas for user c4167eeb95ca4a95a7db1c8e2491a411 and project 21155f0418884af191e3e7981904730c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:46:49.311490 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:46:49.313860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:46:49.363116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-950c6766-204e-4550-b9a0-82406304b769 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.577921 Jul 01 19:46:49.363702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 452/911] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:46:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 19:46:49.381590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c217ffd6-513f-4d57-892e-3f51b6a2551b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:49.382681 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c217ffd6-513f-4d57-892e-3f51b6a2551b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:49.462485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c217ffd6-513f-4d57-892e-3f51b6a2551b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:49.471454 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c217ffd6-513f-4d57-892e-3f51b6a2551b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1237 microversion: 2.1 time: 0.101548 Jul 01 19:46:49.473185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 460/912] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:49 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:50.490386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:50.491348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:50.498308 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:50.498764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:50.499547 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:50.499980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:50.572030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:50.580332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a2f2cb1a-fb65-4687-bb8a-b1e9712358e3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1297 microversion: 2.1 time: 0.094032 Jul 01 19:46:50.581142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 453/913] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:50 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:51.601142 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:51.601729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:51.609011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:51.609461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:51.610273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:51.610711 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:51.950203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:51.958947 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8a12aca-9c3e-4a36-b9d3-a471758763d3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.361626 Jul 01 19:46:51.960058 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 461/914] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:51 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:52.379177 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-660292ce-eac7-424e-a323-cde37901ca04 req-db4bd0e0-f98a-4c54-bcc2-6272567572d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8136085-6ab5-40e8-ba79-3f2e26dd2a3b", "tag": "f62a80e4-c622-4bb4-acf5-83171311ea5c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:52.390748 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-660292ce-eac7-424e-a323-cde37901ca04 req-db4bd0e0-f98a-4c54-bcc2-6272567572d9 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:52.391393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-660292ce-eac7-424e-a323-cde37901ca04 req-db4bd0e0-f98a-4c54-bcc2-6272567572d9 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:52.405419 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-660292ce-eac7-424e-a323-cde37901ca04 req-db4bd0e0-f98a-4c54-bcc2-6272567572d9 service nova] Creating event network-changed:f62a80e4-c622-4bb4-acf5-83171311ea5c for instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b on hv-cinder-83124 Jul 01 19:46:52.410530 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-660292ce-eac7-424e-a323-cde37901ca04 req-db4bd0e0-f98a-4c54-bcc2-6272567572d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035144 Jul 01 19:46:52.411665 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 454/915] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:52.976865 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:52.977347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:52.985308 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:52.985793 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:52.986556 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:52.986990 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:53.123584 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:53.131481 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-951a54e6-b022-46a1-a5ef-ef1f843b8b33 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.158535 Jul 01 19:46:53.132056 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 462/916] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:52 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:54.149917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:54.150670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:54.156806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:54.157257 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:54.158027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:54.158468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:54.291557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:54.299301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-807a19a6-287f-47aa-ab7c-21722f855999 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.154536 Jul 01 19:46:54.300314 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 455/917] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:54 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:55.316637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:55.317415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:55.324917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:55.325355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:55.326159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:55.326587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:55.522728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:55.539267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-174c2ec4-74da-436a-843d-f90d02b768be tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.226691 Jul 01 19:46:55.541707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 463/918] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:55 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:56.558624 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:56.560192 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:56.569099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:56.569703 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:56.571026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:56.571698 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:56.722797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:56.730478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8ee5dce4-e9af-4bdd-9f64-5cb9239f2a35 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.176989 Jul 01 19:46:56.731004 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 456/919] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:56 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:57.748143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:57.748684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:57.755494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:57.755948 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:57.756709 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:57.757158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:57.890881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:57.899122 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d6b5e4f6-dd97-4baa-839e-79b1e5c2200b tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.154962 Jul 01 19:46:57.899795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 464/920] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:57 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:46:58.004156 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-19407b40-ffb3-448a-8c18-09de7730e0ea req-e4fc89ef-3c29-4715-9cd8-721a73725297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8136085-6ab5-40e8-ba79-3f2e26dd2a3b", "name": "network-vif-plugged", "status": "completed", "tag": "f62a80e4-c622-4bb4-acf5-83171311ea5c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:58.013902 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-19407b40-ffb3-448a-8c18-09de7730e0ea req-e4fc89ef-3c29-4715-9cd8-721a73725297 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:58.014777 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-19407b40-ffb3-448a-8c18-09de7730e0ea req-e4fc89ef-3c29-4715-9cd8-721a73725297 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:58.028131 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-19407b40-ffb3-448a-8c18-09de7730e0ea req-e4fc89ef-3c29-4715-9cd8-721a73725297 service nova] Creating event network-vif-plugged:f62a80e4-c622-4bb4-acf5-83171311ea5c for instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b on hv-cinder-83124 Jul 01 19:46:58.045570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-19407b40-ffb3-448a-8c18-09de7730e0ea req-e4fc89ef-3c29-4715-9cd8-721a73725297 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045138 Jul 01 19:46:58.046707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 457/921] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:46:58.916305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:58.916891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:46:58.923795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:58.924247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:58.925013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:46:58.925452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:46:59.060995 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:46:59.068879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6c4e775a-dc3e-452c-b699-14cfb890b5f1 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1362 microversion: 2.1 time: 0.156442 Jul 01 19:46:59.069452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 465/922] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:46:58 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:00.086744 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:00.087432 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:00.089857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:00.090542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:00.095705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:00.096178 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:00.096965 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:00.097377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:00.233775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:00.241639 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-20f7a1bc-018f-461e-8fdb-54498e0ae66f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1547 microversion: 2.1 time: 0.159068 Jul 01 19:47:00.242174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 458/923] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:00 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:00.258081 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:00.258548 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:00.260399 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:00.266315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:00.266756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:00.267513 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:00.267939 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:00.345683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8378d0c6-9687-4ce6-a012-812489974148 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091537 Jul 01 19:47:00.346371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 466/924] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:47:00 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:01.297998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-ffbda191-eea6-4a10-a29d-1913aa7c1950 req-51d23c50-3254-446f-85d3-2380ec3a161c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8136085-6ab5-40e8-ba79-3f2e26dd2a3b", "tag": "f62a80e4-c622-4bb4-acf5-83171311ea5c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:47:01.306828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ffbda191-eea6-4a10-a29d-1913aa7c1950 req-51d23c50-3254-446f-85d3-2380ec3a161c service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:01.307928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ffbda191-eea6-4a10-a29d-1913aa7c1950 req-51d23c50-3254-446f-85d3-2380ec3a161c service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:01.319544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-ffbda191-eea6-4a10-a29d-1913aa7c1950 req-51d23c50-3254-446f-85d3-2380ec3a161c service nova] Creating event network-changed:f62a80e4-c622-4bb4-acf5-83171311ea5c for instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b on hv-cinder-83124 Jul 01 19:47:01.325680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-ffbda191-eea6-4a10-a29d-1913aa7c1950 req-51d23c50-3254-446f-85d3-2380ec3a161c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031326 Jul 01 19:47:01.326622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 459/925] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:34.999658 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:35.001172 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=54 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:35.001306 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:35.002041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:35.006267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-a0d662c2-e773-4eaa-a1c2-6233f91ceeac req-f73954f7-ff85-4c4f-b69a-79ee9481560b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:47:35.006944 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:35.007471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:35.015680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a0d662c2-e773-4eaa-a1c2-6233f91ceeac req-f73954f7-ff85-4c4f-b69a-79ee9481560b service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:35.016007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:35.016188 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a0d662c2-e773-4eaa-a1c2-6233f91ceeac req-f73954f7-ff85-4c4f-b69a-79ee9481560b service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:35.016396 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:35.017169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:35.017689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:35.029164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-a0d662c2-e773-4eaa-a1c2-6233f91ceeac req-f73954f7-ff85-4c4f-b69a-79ee9481560b service nova] Creating event network-changed:1e7ea8a1-39e7-4142-b19c-19006b3a3154 for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 on hv-cinder-83124 Jul 01 19:47:35.035346 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-a0d662c2-e773-4eaa-a1c2-6233f91ceeac req-f73954f7-ff85-4c4f-b69a-79ee9481560b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Jul 01 19:47:35.036163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 460/926] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:35.050725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:47:35.138455 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-675f801f-3064-4d08-b149-615355323be0 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 204 len: 0 microversion: 2.1 time: 0.140543 Jul 01 19:47:35.139811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 467/927] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:47:34 2022] DELETE /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:47:35.149272 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:35.150008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:35.160842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:35.161323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:35.163034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:35.163034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:35.490988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:35.499205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aeb8add5-835d-406a-8f29-6186a39deef1 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.354812 Jul 01 19:47:35.500006 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 461/928] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:35 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:36.519070 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:36.519770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:36.526603 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:36.527062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:36.527816 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:36.528249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:36.745400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:36.753651 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-48f9dee9-76d1-4dc3-a141-e070e9e16d8c tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1569 microversion: 2.1 time: 0.239341 Jul 01 19:47:36.754360 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 468/929] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:36 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:37.771356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:37.771928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:37.778994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:37.779445 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:37.780162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:37.780626 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:37.797393 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-f9ba3049-daa9-4a94-bde6-5c980c4e2c33 req-31178647-d812-466c-87fe-90c9b297d5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8e5709-0263-4b71-a560-06dc39f1a1d6", "name": "network-vif-deleted", "tag": "1e7ea8a1-39e7-4142-b19c-19006b3a3154"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:47:37.807199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f9ba3049-daa9-4a94-bde6-5c980c4e2c33 req-31178647-d812-466c-87fe-90c9b297d5a6 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:37.807646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f9ba3049-daa9-4a94-bde6-5c980c4e2c33 req-31178647-d812-466c-87fe-90c9b297d5a6 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:37.820053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-f9ba3049-daa9-4a94-bde6-5c980c4e2c33 req-31178647-d812-466c-87fe-90c9b297d5a6 service nova] Creating event network-vif-deleted:1e7ea8a1-39e7-4142-b19c-19006b3a3154 for instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 on hv-cinder-83124 Jul 01 19:47:37.825772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-f9ba3049-daa9-4a94-bde6-5c980c4e2c33 req-31178647-d812-466c-87fe-90c9b297d5a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032253 Jul 01 19:47:37.826648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 469/930] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:47:37.847647 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e3430faccb4db28f9439ac4e13cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:37.855256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b7007040-cba8-4f03-9b3c-01615cbca2ea tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 200 len: 1383 microversion: 2.1 time: 0.087885 Jul 01 19:47:37.855829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 462/931] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:37 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 1383 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:38.874650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:38.875339 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] [instance: 9f8e5709-0263-4b71-a560-06dc39f1a1d6] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:38.882652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:38.883141 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:38.883886 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:38.884311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:38.897740 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] HTTP exception thrown: Instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 could not be found. Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Request method failure captured: Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 HTTP/1.1 Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv03Y4xyoqJkdERqH4NCkGhomifSGuldbGIdoshEX5te6jl4tyg1dCQjQo0X-F9MwCkwi677A6x_ngcvP5hxw3RuTJ5jbjMBKy8vk9Y7lUtWHY1vcsBss7AkTtl0-qwfvdDSuDQhfSPq8qUYJSaa3LKnGR-Jc-QdhwY_e4doDzfwHSug Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: c1d1142c18b54c03a1106fb2d1f1b7ec Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestShelveInstance-1774386062 Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:47:38.899385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c1d1142c18b54c03a1106fb2d1f1b7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c1d1142c18b54c03a1106fb2d1f1b7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c1d1142c18b54c03a1106fb2d1f1b7ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c1d1142c18b54c03a1106fb2d1f1b7ec", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestShelveInstance-1774386062 Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: c1d1142c18b54c03a1106fb2d1f1b7ec Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestShelveInstance-1774386062 Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-TestShelveInstance-1774386062-project Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 44e3430faccb4db28f9439ac4e13cf26 Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestShelveInstance-1774386062-project Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 could not be found. Jul 01 19:47:38.900920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '9f8e5709-0263-4b71-a560-06dc39f1a1d6'} Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 could not be found. Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:47:38.901789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 could not be found. Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 could not be found. Jul 01 19:47:38.903345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:38.904700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Returning 404 to user: Instance 9f8e5709-0263-4b71-a560-06dc39f1a1d6 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:47:38.904700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-db714f42-3b22-4894-a205-15f404900bb7 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6" status: 404 len: 111 microversion: 2.1 time: 0.030625 Jul 01 19:47:38.904700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 470/932] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:38 2022] GET /compute/v2.1/servers/9f8e5709-0263-4b71-a560-06dc39f1a1d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:47:39.075268 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c000c9f1-85c1-4aa3-b6d3-c75cd0920049 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] Calling method '.version_select at 0x7f4764740160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:39.095470 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c000c9f1-85c1-4aa3-b6d3-c75cd0920049 tempest-TestShelveInstance-1774386062 tempest-TestShelveInstance-1774386062-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1560650810" status: 202 len: 0 microversion: 2.1 time: 0.024766 Jul 01 19:47:39.096042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 463/933] 10.222.0.61 () {58 vars in 1253 bytes} [Fri Jul 1 19:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1560650810 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:47:41.580378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:41.580961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:41.587794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:41.588230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:41.588981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:41.589405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:41.613585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cccaa2ce-1a9a-44f2-8a03-2e444f20d3ee tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/ips" status: 200 len: 151 microversion: 2.20 time: 0.037059 Jul 01 19:47:41.614271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 471/934] 10.222.0.61 () {60 vars in 1288 bytes} [Fri Jul 1 19:47:41 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:47:44.033142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:47:44.033789 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:44.040669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:44.041013 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:44.042136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:44.042577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:44.074223 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lazy-loading 'flavor' on Instance uuid 6319e331-4ca0-42c3-887a-900720c79f78 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:47:44.347523 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-93f82540-4c2b-4595-bf6e-a7ce5961b76a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/action" status: 202 len: 0 microversion: 2.20 time: 0.319058 Jul 01 19:47:44.348484 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 464/935] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jul 1 19:47:44 2022] POST /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:47:44.359924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:44.361076 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:44.368317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:44.369012 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:44.369811 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:44.370304 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:44.502920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:44.511143 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:44.512673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:44.513840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fdb327a0-a41e-45d7-a398-9110a8a5a065 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.161029 Jul 01 19:47:44.514440 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 472/936] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:44 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:45.533669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:45.534472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:45.540785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:45.541486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:45.544704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:45.544704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:45.678545 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:45.690318 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:45.692012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:45.694171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d7ef91a7-db58-4f8c-ace6-f08b09f5d2ff tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.165058 Jul 01 19:47:45.695277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 465/937] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:45 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:46.208908 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:46.209422 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:46.216896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:46.217427 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:46.218433 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:46.219038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:46.244675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8cef8f70-d8a2-49bc-b30c-73414cd797a1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/ips" status: 200 len: 149 microversion: 2.1 time: 0.039937 Jul 01 19:47:46.250493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 473/938] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:47:46 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:46.713548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:46.714165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:46.721471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:46.721913 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:46.722725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:46.723150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:46.863128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:46.871225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:46.872705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:46.873864 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6cf275d1-44e9-494d-b093-4758f52a1ff4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.164487 Jul 01 19:47:46.874464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 466/939] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:46 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:47.581842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:47:47.583000 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:47.589593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:47.590077 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:47.590839 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:47.591285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:47.877522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0fcd1872-2807-42b3-8b44-76c888917143 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299452 Jul 01 19:47:47.878235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 474/940] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:47:47 2022] POST /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:47.896757 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:47.898024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:47.905099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:47.905549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:47.906349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:47.906800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:48.039300 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:48.050370 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:48.051849 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:48.053039 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aff95881-78db-4f10-af79-c9bf99eaf8c2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.160223 Jul 01 19:47:48.053585 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 467/941] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:47 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:49.075616 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:49.076342 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:49.083094 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:49.083547 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:49.084321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:49.084754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:49.214080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:49.222432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:49.223911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:49.225093 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-24cfd550-ec76-492a-9a5c-3d83e22fa6b4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.155397 Jul 01 19:47:49.225646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 475/942] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:49 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:50.247338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:50.248095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:50.256557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:50.257112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:50.258099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:50.258642 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:50.408196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:50.416910 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:50.418528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:50.419688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5416d8a0-1f9e-457a-94d8-c9ec0820670b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.178569 Jul 01 19:47:50.420262 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 468/943] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:50 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:51.443318 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:51.447003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:51.452882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:51.453336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:51.454140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:51.454582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:51.590660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:51.598935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:51.600436 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:51.601607 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2bc68119-78f8-40d6-b3b6-e661d62a1760 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.164956 Jul 01 19:47:51.602209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 476/944] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:51 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:52.624258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:52.625199 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:52.636452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:52.637230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:52.638252 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:52.638688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:52.949651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:52.960702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:52.962900 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:52.964275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-310075d4-0c3c-4f45-9352-5693ba399a84 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.346575 Jul 01 19:47:52.965066 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 469/945] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:52 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:53.986823 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:53.987645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:53.997748 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:53.998237 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:53.998976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:53.999423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:54.134950 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:54.143349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:54.144845 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:54.146038 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f49789b-1988-47b2-8846-62e879dcc608 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.165654 Jul 01 19:47:54.146603 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 477/946] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:53 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:55.168249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:55.169230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:55.180069 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.180801 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.182029 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.182784 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.316670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:55.326373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:55.328644 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:55.330617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5ce2ca53-de61-43de-87b7-5ae1cfc5860f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.168550 Jul 01 19:47:55.338502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 470/947] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:55 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:55.428378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:47:55.429460 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:55.436416 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.436860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.437609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.438074 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.524093 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Invalid volume: volume 56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c is already attached to instances: be86e9b5-d5ca-4775-ba1b-041e6031db62 Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments HTTP/1.1 Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 74 Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:47:55.526530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {"volumeAttachment": {"volumeId": "56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c"}} Jul 01 19:47:55.528192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Invalid volume: volume 56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c is already attached to instances: be86e9b5-d5ca-4775-ba1b-041e6031db62 Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'server_id': 'be86e9b5-d5ca-4775-ba1b-041e6031db62', 'body': {'volumeAttachment': {'volumeId': '56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c'}}} Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c is already attached to instances: be86e9b5-d5ca-4775-ba1b-041e6031db62 Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:55.529032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c is already attached to instances: be86e9b5-d5ca-4775-ba1b-041e6031db62 Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:47:55.530471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c is already attached to instances: be86e9b5-d5ca-4775-ba1b-041e6031db62 Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 400 to user: Invalid volume: volume 56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c is already attached to instances: be86e9b5-d5ca-4775-ba1b-041e6031db62 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-89d71499-fb89-468e-861f-f0b09b0348e0 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103813 Jul 01 19:47:55.532030 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 478/948] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:47:55 2022] POST /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:47:55.588452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:55.588949 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:55.595423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.595879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.596680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.597110 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.681626 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'services' on Instance uuid be86e9b5-d5ca-4775-ba1b-041e6031db62 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:47:55.768434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-129a45cd-669e-4a10-86ee-eda2183e2499 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments/56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c" status: 202 len: 0 microversion: 2.1 time: 0.183843 Jul 01 19:47:55.769349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 471/949] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:47:55 2022] DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments/56e2f010-dcd4-4cbf-9fa7-f45296dbdf7c => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:47:55.777528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:55.778561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:55.784856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.785313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.786057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:55.786617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:55.817975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-88c7b2aa-4288-4692-ad90-1a92b6bb2b6d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Jul 01 19:47:55.818561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 479/950] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:47:55 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:56.362277 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:56.363087 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:56.371591 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:56.372264 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:56.373230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:56.373850 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:56.510512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:56.518887 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:56.520390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:56.521559 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f279d6a3-6100-4ad3-addf-a6096296fec9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.166233 Jul 01 19:47:56.522149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 472/951] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:56 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:56.830060 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:56.830982 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:56.837868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:56.838333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:56.839078 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:56.839500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:56.868801 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e14e03e1-ac0a-4c6b-b521-7ac2c70a39b1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042814 Jul 01 19:47:56.869348 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 480/952] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:47:56 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:47:56.937681 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:56.938224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:56.944456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:56.944898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:56.945978 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:56.946447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:56.971400 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:47:57.026534 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:57.058295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-060a51f0-930d-46c6-b316-d3c47d8cfdd9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 204 len: 0 microversion: 2.1 time: 0.126033 Jul 01 19:47:57.058971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 473/953] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:47:56 2022] DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:47:57.076449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:57.077101 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:57.083290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:57.083745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:57.084509 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:57.084944 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:57.221598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:57.229286 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c97b3393-e092-4491-b26d-1ef01fac513f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1681 microversion: 2.1 time: 0.165922 Jul 01 19:47:57.229852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 481/954] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:57 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:57.542414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:57.543284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:57.551648 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:57.552205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:57.553160 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:57.553707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:57.699382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:57.721566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:57.721566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:57.721566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c9941095-66ce-4894-a578-65a8610f13bb tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1743 microversion: 2.20 time: 0.182930 Jul 01 19:47:57.722146 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 474/955] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:57 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:58.247334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:58.247912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:58.255252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:58.255682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:58.256497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:58.256931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:58.433368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:58.551936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:58.559729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ed26b42f-4238-48d0-b908-6ce9d5257e01 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1681 microversion: 2.1 time: 0.316478 Jul 01 19:47:58.560305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 482/956] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:58 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1681 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:58.739145 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:58.739757 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:58.746913 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:58.747364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:58.748205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:58.748583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:58.882130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:58.893226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:58.895762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:58.897635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d819749c-88ad-4dfd-84c6-b42428a530d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1743 microversion: 2.20 time: 0.162201 Jul 01 19:47:58.898531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 475/957] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:58 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:59.577595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:59.578226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:59.584989 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:59.585324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:59.586102 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:59.586530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:59.806097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:47:59.814523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ce956560-649b-4829-b560-2be4d34d1ca2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1681 microversion: 2.1 time: 0.240987 Jul 01 19:47:59.815181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 483/958] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:47:59 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:59.918266 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:59.919119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:47:59.927960 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:59.928976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:47:59.930202 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:47:59.931230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:00.120531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:00.129322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:00.130847 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:00.132015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b8955e9f-d3c3-4530-8f0e-edf385f29a51 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1743 microversion: 2.20 time: 0.217914 Jul 01 19:48:00.132566 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 476/959] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:47:59 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:00.341825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-810ad55c-5d49-43c6-9e1a-e5981e91ed4d req-feaaefda-ff35-4166-aa0a-49ba3d3440ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "name": "network-vif-plugged", "status": "completed", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:00.352683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-810ad55c-5d49-43c6-9e1a-e5981e91ed4d req-feaaefda-ff35-4166-aa0a-49ba3d3440ed service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:00.353133 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-810ad55c-5d49-43c6-9e1a-e5981e91ed4d req-feaaefda-ff35-4166-aa0a-49ba3d3440ed service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:00.365592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-810ad55c-5d49-43c6-9e1a-e5981e91ed4d req-feaaefda-ff35-4166-aa0a-49ba3d3440ed service nova] Creating event network-vif-plugged:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:48:00.375245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-810ad55c-5d49-43c6-9e1a-e5981e91ed4d req-feaaefda-ff35-4166-aa0a-49ba3d3440ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037711 Jul 01 19:48:00.376184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 484/960] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:00.539357 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-3026b11e-d844-4cf2-b103-60364f2c6478 req-2a1e4f03-5645-4587-8a0f-f25cfe1c6916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be86e9b5-d5ca-4775-ba1b-041e6031db62", "name": "network-vif-deleted", "tag": "a59df434-bb84-4057-859f-34ae4a4f55d6"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:00.547738 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-3026b11e-d844-4cf2-b103-60364f2c6478 req-2a1e4f03-5645-4587-8a0f-f25cfe1c6916 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:00.548179 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-3026b11e-d844-4cf2-b103-60364f2c6478 req-2a1e4f03-5645-4587-8a0f-f25cfe1c6916 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:00.559661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-3026b11e-d844-4cf2-b103-60364f2c6478 req-2a1e4f03-5645-4587-8a0f-f25cfe1c6916 service nova] Creating event network-vif-deleted:a59df434-bb84-4057-859f-34ae4a4f55d6 for instance be86e9b5-d5ca-4775-ba1b-041e6031db62 on hv-cinder-83124 Jul 01 19:48:00.565113 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-3026b11e-d844-4cf2-b103-60364f2c6478 req-2a1e4f03-5645-4587-8a0f-f25cfe1c6916 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029119 Jul 01 19:48:00.568591 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 477/961] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:00.833261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:00.834053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:00.840536 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:00.841069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:00.841831 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:00.842311 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:00.873214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:00.873645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:00.874174 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'fault' on Instance uuid be86e9b5-d5ca-4775-ba1b-041e6031db62 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:48:00.916116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:00.923745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9df33f3d-4403-40e5-a94a-61ace7232465 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 200 len: 1331 microversion: 2.1 time: 0.095363 Jul 01 19:48:00.933235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 485/962] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:00 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:01.151656 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:01.153060 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:01.160393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:01.160814 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:01.162054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:01.162054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:01.307962 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:01.316785 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:01.318707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:01.319956 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-155e40f7-10eb-4fb0-999f-336f24197c57 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1743 microversion: 2.20 time: 0.173234 Jul 01 19:48:01.320836 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 478/963] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:01 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:01.945033 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:01.946460 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:01.958694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:01.959830 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:01.960754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:01.961545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:01.977966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 HTTP/1.1 Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:48:01.979600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:48:01.981145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'be86e9b5-d5ca-4775-ba1b-041e6031db62'} Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:48:01.982075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:48:01.983549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:48:01.985140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:48:01.985140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cfd90ee3-8eb5-454c-89d1-3bfc59492b45 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 404 len: 111 microversion: 2.1 time: 0.042518 Jul 01 19:48:01.985140 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 486/964] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:01 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:48:01.992577 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-61faa478-684b-438c-adf1-a79180a18990 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '.version_select at 0x7f47648d2430>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:02.014471 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-61faa478-684b-438c-adf1-a79180a18990 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807172828" status: 202 len: 0 microversion: 2.1 time: 0.028216 Jul 01 19:48:02.015003 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 479/965] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jul 1 19:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807172828 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:48:02.338842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:02.339449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:02.345838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:02.346315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:02.347067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:02.347487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:02.497345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:02.506106 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:02.507587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:02.508846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dd4130ad-4c7d-4864-a651-3043baa5bc9e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1743 microversion: 2.20 time: 0.173995 Jul 01 19:48:02.509394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 487/966] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:02 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:02.888325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7a78f742-1d13-42ec-b162-d9446d21820e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: .version_select at 0x7f4764898e50>, body: {"keypair": {"name": "tempest-keypair-1553970768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTsWQSZUzmVj9bYZGq7KGeNihA32PJYGcIspJZ2/mTzz/jqECAxUBojItb9svyuDlke4MiBqFvpIxmVg9gs4oOJOwUYzTO2QL1Cm/FhV+PcWcL4mKBUbb4IWyaMBgl5Kg=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:02.903120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-7a78f742-1d13-42ec-b162-d9446d21820e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:48:02.907333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-7a78f742-1d13-42ec-b162-d9446d21820e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:48:02.932695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7a78f742-1d13-42ec-b162-d9446d21820e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048945 Jul 01 19:48:02.933291 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 480/967] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:48:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:03.526803 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:03.527445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:03.534131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:03.534579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:03.535352 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:03.535771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:03.744673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:03.753018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:03.754694 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:03.756310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c52fc10a-937c-4f33-ba59-a3b7e272b66e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.233080 Jul 01 19:48:03.756779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 488/968] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:03 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:04.390389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1038696664", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bede229f-3edc-4006-b398-af17b8fdb00e"}], "security_groups": [{"name": "tempest-securitygroup--4953906"}], "key_name": "tempest-keypair-1553970768", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:04.504521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] validate_networks() for [('bede229f-3edc-4006-b398-af17b8fdb00e', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:48:04.775539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:04.776836 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:04.784699 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:04.785467 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:04.786491 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:04.787110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:05.035754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:05.039017 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:48:05.039768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:48:05.040428 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:48:05.040994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:48:05.041621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:48:05.056341 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:05.057128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:05.058168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:05.058776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:05.065867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:05.067612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:05.068968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7a34ecbf-551b-49b1-af4f-e33d9c73b82a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.297634 Jul 01 19:48:05.070044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 489/969] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:04 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:05.090926 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:48:05.096892 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Getting quotas for user 3229929e0f2f4c9fbb3dc6413b6db151 and project 7d037922bcac4bc6babcd8183982073e. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:48:05.111158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:48:05.118636 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:48:05.185254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-738be4ee-c6fa-47c0-894e-96aebd58d860 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.799799 Jul 01 19:48:05.186099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 481/970] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:48:04 2022] POST /compute/v2.1/servers => generated 399 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 19:48:05.196728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4306a53a-3658-48a9-971f-d79d2ec4d3b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:05.197347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4306a53a-3658-48a9-971f-d79d2ec4d3b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:05.204548 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:05.261072 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4306a53a-3658-48a9-971f-d79d2ec4d3b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:05.268335 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4306a53a-3658-48a9-971f-d79d2ec4d3b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1242 microversion: 2.1 time: 0.076041 Jul 01 19:48:05.268917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 490/971] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:05 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:48:06.088750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:06.090105 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:06.092387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:06.100826 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:06.101285 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:06.102085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:06.102546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:06.258278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:06.267196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:06.268853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:06.270107 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3e1348b2-b914-4324-9464-8c270d712d77 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.185891 Jul 01 19:48:06.286865 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:06.289242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:06.295226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 482/972] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:06 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:06.297992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:06.298654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:06.299609 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:06.300230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:06.403442 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:06.416356 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3b65f069-a7e2-4827-b6d4-3f103b3b52aa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1302 microversion: 2.1 time: 0.133463 Jul 01 19:48:06.416960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 491/973] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:06 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:07.294530 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:07.295225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:07.307474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:07.308011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:07.308885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:07.311701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:07.435582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:07.437263 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:07.451321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:07.454781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:07.456341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:07.457010 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:07.719557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:07.732804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:07.738140 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:07.741684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c8c006f8-f2e3-4bc3-8178-f63880999a85 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.453876 Jul 01 19:48:07.753063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 483/974] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:07 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:07.802441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:07.810697 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d9efe3b8-2d1d-4031-a806-6364981cbdd2 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.380065 Jul 01 19:48:07.817527 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 492/975] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:07 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:08.297490 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-a931fcc1-194e-4b0c-aadf-73a528554d91 req-c112a107-91cd-452c-ae67-13d6986a8136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55633a59-8bc6-45d2-9e57-97fd1bdb3eb8", "tag": "ef645cf1-5a26-4b7f-a6fb-475af444f8d9"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:08.312361 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a931fcc1-194e-4b0c-aadf-73a528554d91 req-c112a107-91cd-452c-ae67-13d6986a8136 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:08.314012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a931fcc1-194e-4b0c-aadf-73a528554d91 req-c112a107-91cd-452c-ae67-13d6986a8136 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:08.330761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-a931fcc1-194e-4b0c-aadf-73a528554d91 req-c112a107-91cd-452c-ae67-13d6986a8136 service nova] Creating event network-changed:ef645cf1-5a26-4b7f-a6fb-475af444f8d9 for instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 on hv-cinder-83124 Jul 01 19:48:08.336450 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-a931fcc1-194e-4b0c-aadf-73a528554d91 req-c112a107-91cd-452c-ae67-13d6986a8136 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045641 Jul 01 19:48:08.337394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 484/976] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:08.760733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:08.761686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:08.781434 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:08.782722 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:08.784380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:08.785431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:08.835137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:08.835849 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:08.847954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:08.848616 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:08.849413 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:08.849836 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:09.134654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:09.143441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:09.144946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:09.146364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4a1fe072-38fd-46a7-a453-05d868c5a5f1 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.389468 Jul 01 19:48:09.157454 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:09.158312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 493/977] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:08 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:09.164317 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2a8b7c6f-54a0-42aa-9a06-710355d937cd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.334132 Jul 01 19:48:09.165003 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 485/978] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:08 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:48:10.164970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:10.165641 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:10.172789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:10.173245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:10.174050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:10.174496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:10.186612 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:10.187442 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:10.194901 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:10.195799 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:10.196865 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:10.197333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:10.378325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:10.386867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:10.388352 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:10.389523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5e84a96a-5169-4f2b-9432-afe0864bc8c6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.228655 Jul 01 19:48:10.390371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 494/979] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:10 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:10.400244 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:10.408077 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9b9f1ac1-0ad4-4ca8-a270-5000dfd99d93 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.226566 Jul 01 19:48:10.408680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 486/980] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:10 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:11.408240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:11.408868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:11.415812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:11.416291 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:11.417025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:11.417460 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:11.424716 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:11.425344 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:11.433770 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:11.434247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:11.435181 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:11.436609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:11.653049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:11.657371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:11.662152 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-699499da-ecdb-4155-ab16-b7ec3e898cd6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.241205 Jul 01 19:48:11.662757 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 487/981] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:11 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:48:11.668778 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:11.670449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:11.671741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fa30710c-19ec-4fab-9ed2-0c65921ed9d7 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.267481 Jul 01 19:48:11.672287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 495/982] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:11 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:12.679814 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:12.680719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:12.691053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:12.691843 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:12.699458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:12.700272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:12.701330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:12.702035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:12.715269 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:12.715887 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:12.716700 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:12.717134 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:12.920880 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:12.922200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:12.930946 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a901ca20-4bea-44c7-a68e-3e0f3f515268 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.254907 Jul 01 19:48:12.940128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 488/983] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:12 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:12.943322 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:12.945632 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:12.946884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1b18b050-473a-4118-9bb7-a4fbcac65a97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.260165 Jul 01 19:48:12.947514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 496/984] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:12 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:13.948139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:13.949622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:13.957172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:13.958231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:13.966513 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:13.967286 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:13.971729 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:13.974284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:13.976666 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:13.977205 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:13.978088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:13.978725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:14.471808 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:14.479726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:14.481524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:14.482360 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:14.483406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c79b44a9-d22c-41ed-a97a-9cf98469d2d4 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1738 microversion: 2.20 time: 0.521194 Jul 01 19:48:14.483952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 497/985] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:13 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:14.489504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-034cab38-054b-41be-a975-f53b51cf5707 req-42c66d74-3d0c-4d30-8ddc-30282358362a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55633a59-8bc6-45d2-9e57-97fd1bdb3eb8", "name": "network-vif-plugged", "status": "completed", "tag": "ef645cf1-5a26-4b7f-a6fb-475af444f8d9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:14.491349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a1c79f03-32da-44d9-b1c3-9ceda647adfe tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.547211 Jul 01 19:48:14.498187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-034cab38-054b-41be-a975-f53b51cf5707 req-42c66d74-3d0c-4d30-8ddc-30282358362a service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:14.498705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-034cab38-054b-41be-a975-f53b51cf5707 req-42c66d74-3d0c-4d30-8ddc-30282358362a service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:14.500635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 489/986] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:13 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:14.509840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-034cab38-054b-41be-a975-f53b51cf5707 req-42c66d74-3d0c-4d30-8ddc-30282358362a service nova] Creating event network-vif-plugged:ef645cf1-5a26-4b7f-a6fb-475af444f8d9 for instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 on hv-cinder-83124 Jul 01 19:48:14.514870 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-034cab38-054b-41be-a975-f53b51cf5707 req-42c66d74-3d0c-4d30-8ddc-30282358362a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Jul 01 19:48:14.515524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 498/987] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:15.502690 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:15.504043 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:15.506533 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:15.507265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=10 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:15.509982 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:15.510768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:15.512600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:15.513050 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:15.513332 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:15.513801 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:15.514460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:15.519876 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:15.520328 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:15.521097 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:15.521532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:15.710498 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:15.714672 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:15.719424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:15.720903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:15.722124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e4cb67e8-3b2d-4d4b-af52-18bf10a055ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1720 microversion: 2.20 time: 0.223518 Jul 01 19:48:15.722292 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-db01060e-aa89-4b9e-828a-730e668cc4e6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.217562 Jul 01 19:48:15.722680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 490/988] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:15 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:15.726323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 499/989] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:15 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:48:16.739744 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:16.740356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:16.741139 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:16.741755 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:16.747423 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:16.747882 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:16.748493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:16.748648 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:16.748941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:16.749106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:16.749706 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:16.750179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:16.989688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:16.995604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:16.998991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-240912b8-6420-4b5b-979e-8618b4e687b9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1365 microversion: 2.1 time: 0.263462 Jul 01 19:48:16.999530 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 491/990] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:16 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:17.008350 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:17.010354 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:17.011545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b915c918-e46c-4156-ba1c-a35f659a8572 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1720 microversion: 2.20 time: 0.274618 Jul 01 19:48:17.012066 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 500/991] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:16 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:18.016072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:18.016719 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:18.023754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.024200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.025011 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.025479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.030234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:18.030815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:18.037653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.038146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.038915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.039345 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.224503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:18.228465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:18.231922 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:18.232304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-967e43be-a34b-4f6f-a77e-4e57681b6601 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1555 microversion: 2.1 time: 0.220126 Jul 01 19:48:18.233165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 492/992] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:18 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:18.237179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:18.238880 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:18.240048 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b12515d7-3652-4d23-b81d-01a3782f0603 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1720 microversion: 2.20 time: 0.213810 Jul 01 19:48:18.240754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 501/993] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:18 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:48:18.248553 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:18.249076 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:18.255316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.255766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.256525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.256959 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.335385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cacc1820-4ee2-4b9b-9626-a49260d22fb9 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090517 Jul 01 19:48:18.335994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 493/994] 10.222.0.61 () {58 vars in 1274 bytes} [Fri Jul 1 19:48:18 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:18.380879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-44ead90c-5445-4ab3-9362-7458c6965d88 req-f2217cff-bda4-4cd1-8132-e08ebfba3213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "name": "network-vif-unplugged", "status": "completed", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:18.389838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-44ead90c-5445-4ab3-9362-7458c6965d88 req-f2217cff-bda4-4cd1-8132-e08ebfba3213 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:18.390285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-44ead90c-5445-4ab3-9362-7458c6965d88 req-f2217cff-bda4-4cd1-8132-e08ebfba3213 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:18.404884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-44ead90c-5445-4ab3-9362-7458c6965d88 req-f2217cff-bda4-4cd1-8132-e08ebfba3213 service nova] Creating event network-vif-unplugged:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:48:18.409798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-44ead90c-5445-4ab3-9362-7458c6965d88 req-f2217cff-bda4-4cd1-8132-e08ebfba3213 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033075 Jul 01 19:48:18.410770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 502/995] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:19.259461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:19.260114 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:19.267630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:19.268105 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:19.268862 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:19.269334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:19.291144 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2d060318-0892-48af-812b-4d117e1595a2 req-43e888b7-f621-409a-b0d0-e66b542de642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55633a59-8bc6-45d2-9e57-97fd1bdb3eb8", "tag": "ef645cf1-5a26-4b7f-a6fb-475af444f8d9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:19.300817 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2d060318-0892-48af-812b-4d117e1595a2 req-43e888b7-f621-409a-b0d0-e66b542de642 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:19.301316 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2d060318-0892-48af-812b-4d117e1595a2 req-43e888b7-f621-409a-b0d0-e66b542de642 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:19.313146 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2d060318-0892-48af-812b-4d117e1595a2 req-43e888b7-f621-409a-b0d0-e66b542de642 service nova] Creating event network-changed:ef645cf1-5a26-4b7f-a6fb-475af444f8d9 for instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 on hv-cinder-83124 Jul 01 19:48:19.318508 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2d060318-0892-48af-812b-4d117e1595a2 req-43e888b7-f621-409a-b0d0-e66b542de642 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 Jul 01 19:48:19.319315 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 503/996] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:48:19.650822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:19.654744 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:19.659688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:19.661190 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:19.662415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-61f018d0-14c7-48b8-bce2-a220f75f3c7a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1723 microversion: 2.20 time: 0.407472 Jul 01 19:48:19.662944 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 494/997] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:19 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:19.681151 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4a3c59c-e734-4122-ada0-eb092b10da6a"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:19.682613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:19.689585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:19.690091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:19.691052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:19.691673 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:19.999887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-61577bf1-e2c4-4973-aaea-f0966c6d7c45 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322832 Jul 01 19:48:20.000528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 504/998] 10.222.0.61 () {62 vars in 1363 bytes} [Fri Jul 1 19:48:19 2022] POST /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:48:20.115937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:20.116430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:20.122562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:20.123008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:20.123775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:20.124233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:20.386809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b2d3f33d-922a-4aef-9595-d2b292bc42b5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-volume_attachments/b4a3c59c-e734-4122-ada0-eb092b10da6a" status: 202 len: 0 microversion: 2.20 time: 0.275083 Jul 01 19:48:20.390571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 495/999] 10.222.0.61 () {60 vars in 1456 bytes} [Fri Jul 1 19:48:20 2022] DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-volume_attachments/b4a3c59c-e734-4122-ada0-eb092b10da6a => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:48:20.443852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:20.444452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:20.451444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:20.451871 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:20.452635 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:20.453075 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:20.549690 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-049ce6b0-9b8c-4987-8468-162eb4f19894 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "POST /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/action" status: 202 len: 0 microversion: 2.20 time: 0.109711 Jul 01 19:48:20.550373 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 505/1000] 10.222.0.61 () {62 vars in 1318 bytes} [Fri Jul 1 19:48:20 2022] POST /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:48:20.558968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:20.559575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:20.569139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:20.569623 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:20.570946 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:20.571451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:20.705403 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:20.714392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:20.715888 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:20.717060 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2002af04-990e-413b-a678-09feed48548f tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1671 microversion: 2.20 time: 0.162020 Jul 01 19:48:20.717633 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 496/1001] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:20 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:21.736746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:21.737470 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:21.744960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:21.745395 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:21.746186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:21.746612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:22.018727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:22.027965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:22.030529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:22.032276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dd01b5aa-03a6-4d12-bf36-92ed4cab7aa2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.299874 Jul 01 19:48:22.033165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 506/1002] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:21 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:23.051631 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:23.052198 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:23.059684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:23.060617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:23.062562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:23.063000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:23.203961 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:23.214327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:23.216558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:23.218806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5f3cf2cb-57ed-4410-845a-8220a7c554d2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.171195 Jul 01 19:48:23.219568 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 497/1003] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:23 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:24.237646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:24.238337 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:24.245288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:24.245735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:24.246530 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:24.246968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:24.394147 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:24.403008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:24.404579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:24.405773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cb503ad8-7498-4410-88f9-2abf526ceac6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.172345 Jul 01 19:48:24.406356 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 507/1004] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:24 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:25.424606 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:25.425240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:25.432452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:25.432903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:25.433663 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:25.434178 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:25.573768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:25.582066 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:25.583578 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:25.584789 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c49efd3b-20da-44a4-bb75-cc226577eda3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.164284 Jul 01 19:48:25.585347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 498/1005] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:25 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:26.603595 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:26.604228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:26.611617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:26.612178 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:26.612978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:26.613439 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:26.749497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:26.758086 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:26.759585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:26.760826 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1c04ef0f-006f-45eb-a64e-0f02e24148a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.161326 Jul 01 19:48:26.761338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 508/1006] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:26 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:27.780988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:27.781684 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:27.788751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:27.789208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:27.790103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:27.790546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:28.180101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:28.188718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:28.190230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:28.191670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-907f358e-9631-456a-95fa-c91a7291ae0e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.415527 Jul 01 19:48:28.192426 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 499/1007] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:27 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:29.210937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:29.211534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:29.218631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:29.219086 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:29.219847 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:29.220279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:29.359715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:29.368437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:29.369931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:29.371179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d9eb8710-b181-47ff-89ab-93f57baea756 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.164288 Jul 01 19:48:29.371917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 509/1008] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:29 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:30.391771 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:30.392366 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:30.399480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:30.399914 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:30.400856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:30.401296 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:30.548397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:30.563115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:30.564609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:30.565772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ce727edb-dd2c-48a7-8b0d-21be3cc9a57d tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.178065 Jul 01 19:48:30.577213 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 500/1009] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:30 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:31.082400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:31.083025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:31.089252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:31.089726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:31.090535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:31.091007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:31.114773 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b8031adb-f1ac-4f7a-b302-fc59065e86a6 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/ips" status: 200 len: 145 microversion: 2.1 time: 0.194434 Jul 01 19:48:31.115374 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 510/1010] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:48:30 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/ips => generated 145 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:31.586227 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:31.587048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:31.608245 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:31.608751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:31.609538 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:31.609993 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:31.743390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:31.753370 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:31.754898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:31.756096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7f31d5e5-2459-4b53-a5cf-c595ef529996 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.174815 Jul 01 19:48:31.756622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 501/1011] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:31 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:32.775049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:32.775648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:32.782638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:32.783083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:32.783849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:32.784284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:32.917492 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:32.926794 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:32.928285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:32.929447 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e76c07e5-be6c-46f0-91ac-77b627eb9cc2 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.158547 Jul 01 19:48:32.930016 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 511/1012] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:32 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:33.566880 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8148dfd-1c34-4ec9-ae20-572c738b31df"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:33.568511 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:33.577992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:33.578475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:33.579203 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:33.579631 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:33.951413 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:33.952372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:33.964164 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:33.964886 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:33.966407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:33.967119 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:34.114994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:34.125979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:34.127504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:34.128698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c898f769-891f-41ec-8544-ba8c25dfe987 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.184185 Jul 01 19:48:34.129257 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 512/1013] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:33 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:35.071326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e0645115-fd76-409d-bdd3-3c3692ec6721 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.510903 Jul 01 19:48:35.071962 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 502/1014] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:48:33 2022] POST /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments => generated 194 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:35.147365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:35.148008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:35.154304 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:35.154754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:35.155516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:35.155945 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:35.287660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:35.295803 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:35.297305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:35.298477 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1833e7d9-d0f3-44d0-a6ef-2bd3d6ccff97 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.155328 Jul 01 19:48:35.299069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 513/1015] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:35 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:36.323828 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:36.324848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:36.327879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=42 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:36.337124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:36.337890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:36.339154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:36.339870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:36.484841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:36.493775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:36.495313 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:36.496485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fa01da89-c736-410f-8d94-b64b0a34d38b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.181765 Jul 01 19:48:36.497026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 503/1016] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:36 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:37.515501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:37.516044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:37.519753 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=52 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:37.523766 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:37.524209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:37.525238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:37.525676 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:37.732730 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:37.741712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:37.744011 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:37.745249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c6644e9a-26d5-4d4e-b007-ecadfd5a9ef0 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.234111 Jul 01 19:48:37.745819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 514/1017] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:37 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:38.766323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:38.766936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:38.773822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:38.774302 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:38.775095 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:38.775527 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:38.926722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:38.939167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:38.941385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:38.943200 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-347522cf-e5b2-45c4-b5cc-05d2f0c768a9 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.181968 Jul 01 19:48:38.943976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 504/1018] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:38 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:39.967993 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:39.968632 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:39.975604 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:39.976056 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:39.976823 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:39.977259 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:40.119489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:40.129450 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:40.131804 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:40.132978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-64b58a7b-54a1-44c5-8ffa-e4121d7042ec tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.171212 Jul 01 19:48:40.133544 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 515/1019] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:39 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:40.557270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-e171192b-fa31-44fd-9527-d9be19986338 req-d60a1860-5a25-4243-aa4c-1cf7ac9a3f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "name": "network-vif-plugged", "status": "completed", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:40.566049 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e171192b-fa31-44fd-9527-d9be19986338 req-d60a1860-5a25-4243-aa4c-1cf7ac9a3f33 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:40.566499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e171192b-fa31-44fd-9527-d9be19986338 req-d60a1860-5a25-4243-aa4c-1cf7ac9a3f33 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:40.579915 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-e171192b-fa31-44fd-9527-d9be19986338 req-d60a1860-5a25-4243-aa4c-1cf7ac9a3f33 service nova] Creating event network-vif-plugged:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:48:40.584810 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-e171192b-fa31-44fd-9527-d9be19986338 req-d60a1860-5a25-4243-aa4c-1cf7ac9a3f33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031253 Jul 01 19:48:40.585404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 505/1020] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:41.153493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:41.154113 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:41.161079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:41.161559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:41.162336 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:41.162770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:41.185686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:41.298349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:41.306500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:41.308026 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:41.309198 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-608ae045-2dec-46c8-ab61-3ca0b13c53a6 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.159726 Jul 01 19:48:41.309762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 516/1021] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:41 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:42.479068 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:42.479770 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:42.486622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:42.487074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:42.487846 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:42.488297 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:42.619774 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:42.632102 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:42.634463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:42.636167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5065202a-77dc-409e-bf02-b44c269f327c tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.310780 Jul 01 19:48:42.636921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 506/1022] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:42 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:43.654979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:43.655598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:43.662513 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:43.662960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:43.663724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:43.664153 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:43.809854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:43.818444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:43.819911 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:43.821429 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bb1df9b7-95ac-40a3-b1d0-d76814e91c91 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1729 microversion: 2.20 time: 0.170525 Jul 01 19:48:43.821976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 517/1023] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:43 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:44.742070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:44.743058 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:44.749985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:44.750439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:44.751187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:44.751610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:44.781333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bfcfa692-793e-4e3a-912c-945f79bb2fe5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jul 01 19:48:44.782118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 507/1024] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:48:44 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:44.794442 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:44.794953 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:44.802501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:44.802946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:44.803715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:44.804118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:44.833368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-75df4e3c-6289-49a5-9ffd-7ec7e4996924 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/b8148dfd-1c34-4ec9-ae20-572c738b31df" status: 200 len: 194 microversion: 2.1 time: 0.045133 Jul 01 19:48:44.834216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 518/1025] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jul 1 19:48:44 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/b8148dfd-1c34-4ec9-ae20-572c738b31df => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:44.840447 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:44.840845 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:44.847181 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:44.847618 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:44.848373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:44.848795 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:44.864243 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:44.980991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:44.989132 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:44.990657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:44.991842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-10c0f27e-3033-44f1-971c-55e1dc36684a tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1716 microversion: 2.20 time: 0.155613 Jul 01 19:48:44.992397 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 508/1026] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:48:44 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:48:46.162756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3329d932-eb67-473b-a42b-b33c582f4217"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:48:46.163898 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:46.170779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:46.171228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:46.172036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:46.172466 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:46.469714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c879a029-f369-4256-ab8c-23201b4f03b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "POST /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310874 Jul 01 19:48:46.470366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 519/1027] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:48:46 2022] POST /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:54.021562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:54.022604 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:54.029912 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:54.030398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:54.031173 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:54.031610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:54.063386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c94c61aa-327c-4ed6-af3f-1d7b2869e6b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045767 Jul 01 19:48:54.063923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 509/1028] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:48:54 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:54.209423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:54.210013 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:54.216789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:54.217239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:54.218003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:54.218468 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:54.246775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-094d8b22-a608-4a7e-a797-a93709c2b5f3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/b8148dfd-1c34-4ec9-ae20-572c738b31df" status: 200 len: 194 microversion: 2.1 time: 0.043006 Jul 01 19:48:54.247343 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 520/1029] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jul 1 19:48:54 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/b8148dfd-1c34-4ec9-ae20-572c738b31df => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:54.259802 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:54.260503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:54.267022 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:54.267455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:54.268250 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:54.268688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:54.356233 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lazy-loading 'services' on Instance uuid e8136085-6ab5-40e8-ba79-3f2e26dd2a3b {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:48:54.443533 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e62c91de-3942-4e54-8a2a-72287d81f089 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/b8148dfd-1c34-4ec9-ae20-572c738b31df" status: 202 len: 0 microversion: 2.1 time: 0.189842 Jul 01 19:48:54.444162 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 510/1030] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:48:54 2022] DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/b8148dfd-1c34-4ec9-ae20-572c738b31df => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:48:56.632224 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:56.632776 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:56.639738 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:56.640154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:56.640951 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:56.641379 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:56.670622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-624ef1db-220c-4adb-aad5-738ac803a32e tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/3329d932-eb67-473b-a42b-b33c582f4217" status: 200 len: 194 microversion: 2.1 time: 0.042434 Jul 01 19:48:56.671209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 521/1031] 10.222.0.61 () {58 vars in 1412 bytes} [Fri Jul 1 19:48:56 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/3329d932-eb67-473b-a42b-b33c582f4217 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:48:56.682332 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:56.682860 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:56.689521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:56.689981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:56.690768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:56.691196 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:56.777119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lazy-loading 'services' on Instance uuid e8136085-6ab5-40e8-ba79-3f2e26dd2a3b {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:48:56.857972 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-82da5f04-4f72-4355-9a81-9c429c9947c2 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/3329d932-eb67-473b-a42b-b33c582f4217" status: 202 len: 0 microversion: 2.1 time: 0.180328 Jul 01 19:48:56.858610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 511/1032] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:48:56 2022] DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments/3329d932-eb67-473b-a42b-b33c582f4217 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:48:58.023440 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:58.024445 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:58.031298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.031750 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.032516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.032965 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.063274 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-80ca7df5-d957-4f2a-b54c-a8ecaf35861d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043851 Jul 01 19:48:58.063928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 522/1033] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:48:58 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:48:58.169428 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:58.170507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:58.177031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.177457 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.178295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.178721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.207379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8a81ff16-86c0-4380-9b43-86a5ec9884c5 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042770 Jul 01 19:48:58.207915 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 512/1034] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:48:58 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:48:58.267341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:58.267843 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:58.274248 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.274695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.275452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.275885 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.305040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:48:58.386225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-80f8ec82-ef0c-44c4-b52d-9c6e092962a0 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 204 len: 0 microversion: 2.1 time: 0.122811 Jul 01 19:48:58.386812 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 523/1035] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:48:58 2022] DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:48:58.395110 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:58.395720 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:58.401962 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.402780 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.404547 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:58.404984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:58.542470 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:58.550385 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-359d8aee-2edf-4aa8-af9e-13f7db8ca11f tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1672 microversion: 2.1 time: 0.159102 Jul 01 19:48:58.550928 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 513/1036] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:58 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:48:59.573647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:48:59.574820 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:48:59.585806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:59.586594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:59.587868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:48:59.588588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:48:59.726726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:48:59.734877 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f0a853c-2451-4e08-a6de-70ecec917241 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1672 microversion: 2.1 time: 0.168882 Jul 01 19:48:59.735415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 524/1037] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:48:59 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:00.758896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:00.759506 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:00.768174 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:00.768617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:00.769383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:00.769811 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:00.985296 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:00.993660 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e206f1c6-5f91-4421-bae0-1b2107441b50 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1672 microversion: 2.1 time: 0.238722 Jul 01 19:49:00.994304 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 514/1038] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:00 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:01.626323 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-01f701c5-86e5-4458-a235-25fa3bee01ef req-28f9e88f-9239-4fa2-b7e6-6fdf4a89c70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8136085-6ab5-40e8-ba79-3f2e26dd2a3b", "name": "network-vif-deleted", "tag": "f62a80e4-c622-4bb4-acf5-83171311ea5c"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:01.637312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-01f701c5-86e5-4458-a235-25fa3bee01ef req-28f9e88f-9239-4fa2-b7e6-6fdf4a89c70e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:01.637756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-01f701c5-86e5-4458-a235-25fa3bee01ef req-28f9e88f-9239-4fa2-b7e6-6fdf4a89c70e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:01.651966 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-01f701c5-86e5-4458-a235-25fa3bee01ef req-28f9e88f-9239-4fa2-b7e6-6fdf4a89c70e service nova] Creating event network-vif-deleted:f62a80e4-c622-4bb4-acf5-83171311ea5c for instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b on hv-cinder-83124 Jul 01 19:49:01.657742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-01f701c5-86e5-4458-a235-25fa3bee01ef req-28f9e88f-9239-4fa2-b7e6-6fdf4a89c70e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035015 Jul 01 19:49:01.659145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 525/1039] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:49:02.013465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:02.014086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:02.020968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:02.021463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:02.022278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:02.022742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:02.059537 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:02.059986 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:02.060411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lazy-loading 'fault' on Instance uuid e8136085-6ab5-40e8-ba79-3f2e26dd2a3b {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:49:02.104499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4167eeb95ca4a95a7db1c8e2491a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21155f0418884af191e3e7981904730c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:02.112286 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6705f1c0-2e3c-4c7a-bce1-d6c4d9e6eedc tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 200 len: 1327 microversion: 2.1 time: 0.103992 Jul 01 19:49:02.112882 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 515/1040] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:02 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:03.133593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:03.134781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:03.144968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:03.145411 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:03.146207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:03.146637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:03.160043 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] HTTP exception thrown: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Request method failure captured: Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b HTTP/1.1 Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000JEXxyg8F8K4SmNfRGrhY4P96k1ssR1CNTDaN8egsAy1U43YbyZBevlL350QI9GSxOPwsMV74LzkZr8mCF_xj7TecUsYKgMGJdwAYZws3eZZvmgrCmSFcqyu897kfE0qJ-B5nQQq_0sHfN2tN8vbmtzkcsnaa7t7ADN7HVUfCQWw Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:49:03.161678 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21155f0418884af191e3e7981904730c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21155f0418884af191e3e7981904730c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: c4167eeb95ca4a95a7db1c8e2491a411 Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:03.163216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e8136085-6ab5-40e8-ba79-3f2e26dd2a3b'} Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:03.163988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:03.165307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:03.166682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Returning 404 to user: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:03.166682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ef8e3a69-4fc2-4b78-a99c-d69e850eb21c tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 404 len: 111 microversion: 2.1 time: 0.036498 Jul 01 19:49:03.166682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 526/1041] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:03 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:03.171981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8c9e1f31-ae52-4fd9-abc8-8e7a7238791a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '.version_select at 0x7f47647e4ee0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:03.192747 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8c9e1f31-ae52-4fd9-abc8-8e7a7238791a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050256279" status: 202 len: 0 microversion: 2.1 time: 0.024595 Jul 01 19:49:03.193422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 516/1042] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jul 1 19:49:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050256279 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:49:06.099110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:06.099624 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:06.109769 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:06.110441 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:06.111578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:06.112057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:06.125798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] HTTP exception thrown: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Request method failure captured: Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b HTTP/1.1 Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000JEXxyg8F8K4SmNfRGrhY4P96k1ssR1CNTDaN8egsAy1U43YbyZBevlL350QI9GSxOPwsMV74LzkZr8mCF_xj7TecUsYKgMGJdwAYZws3eZZvmgrCmSFcqyu897kfE0qJ-B5nQQq_0sHfN2tN8vbmtzkcsnaa7t7ADN7HVUfCQWw Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:49:06.127387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21155f0418884af191e3e7981904730c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21155f0418884af191e3e7981904730c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: c4167eeb95ca4a95a7db1c8e2491a411 Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.128946 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e8136085-6ab5-40e8-ba79-3f2e26dd2a3b'} Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:06.129746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.130959 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.132160 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Returning 404 to user: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:06.132160 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b814cc07-b384-4de1-b015-68849bbc93b3 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 404 len: 111 microversion: 2.1 time: 0.035648 Jul 01 19:49:06.132160 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 527/1043] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:49:06 2022] DELETE /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:06.140864 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:06.141499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: e8136085-6ab5-40e8-ba79-3f2e26dd2a3b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:06.148422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:06.148872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:06.149635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:06.150098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:06.163790 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] HTTP exception thrown: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Request method failure captured: Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b HTTP/1.1 Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000JEXxyg8F8K4SmNfRGrhY4P96k1ssR1CNTDaN8egsAy1U43YbyZBevlL350QI9GSxOPwsMV74LzkZr8mCF_xj7TecUsYKgMGJdwAYZws3eZZvmgrCmSFcqyu897kfE0qJ-B5nQQq_0sHfN2tN8vbmtzkcsnaa7t7ADN7HVUfCQWw Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:49:06.165481 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21155f0418884af191e3e7981904730c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21155f0418884af191e3e7981904730c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: c4167eeb95ca4a95a7db1c8e2491a411 Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.167030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'e8136085-6ab5-40e8-ba79-3f2e26dd2a3b'} Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:06.167898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. Jul 01 19:49:06.169265 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:06.170589 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Returning 404 to user: Instance e8136085-6ab5-40e8-ba79-3f2e26dd2a3b could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:06.170589 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5b5f2348-48c6-47fb-8e0b-f7a84a0c4f8a tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b" status: 404 len: 111 microversion: 2.1 time: 0.033373 Jul 01 19:49:06.170589 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 517/1044] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:06 2022] GET /compute/v2.1/servers/e8136085-6ab5-40e8-ba79-3f2e26dd2a3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:07.322905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:07.323411 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:07.330370 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:07.330819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:07.331583 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:07.332012 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:07.345640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] HTTP exception thrown: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Request method failure captured: Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 HTTP/1.1 Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000JEXxyg8F8K4SmNfRGrhY4P96k1ssR1CNTDaN8egsAy1U43YbyZBevlL350QI9GSxOPwsMV74LzkZr8mCF_xj7TecUsYKgMGJdwAYZws3eZZvmgrCmSFcqyu897kfE0qJ-B5nQQq_0sHfN2tN8vbmtzkcsnaa7t7ADN7HVUfCQWw Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:49:07.347279 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21155f0418884af191e3e7981904730c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21155f0418884af191e3e7981904730c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: c4167eeb95ca4a95a7db1c8e2491a411 Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.348779 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'acd8c337-77a5-4fd0-aeef-555fb1ad2d13'} Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:07.349695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.351310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.352985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Returning 404 to user: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:07.352985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4cba4055-e1b7-48ab-b905-8d7cead798b7 tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 404 len: 111 microversion: 2.1 time: 0.030044 Jul 01 19:49:07.352985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 528/1045] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:49:07 2022] DELETE /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:07.358383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:07.358971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] [instance: acd8c337-77a5-4fd0-aeef-555fb1ad2d13] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:07.361417 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:07.367125 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:07.367576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:07.368347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:07.368791 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:07.384574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] HTTP exception thrown: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Request method failure captured: Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 HTTP/1.1 Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000JEXxyg8F8K4SmNfRGrhY4P96k1ssR1CNTDaN8egsAy1U43YbyZBevlL350QI9GSxOPwsMV74LzkZr8mCF_xj7TecUsYKgMGJdwAYZws3eZZvmgrCmSFcqyu897kfE0qJ-B5nQQq_0sHfN2tN8vbmtzkcsnaa7t7ADN7HVUfCQWw Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:49:07.386135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21155f0418884af191e3e7981904730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21155f0418884af191e3e7981904730c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21155f0418884af191e3e7981904730c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 21155f0418884af191e3e7981904730c Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-522248157 Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: c4167eeb95ca4a95a7db1c8e2491a411 Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeTestJSON-522248157-project Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.387619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'acd8c337-77a5-4fd0-aeef-555fb1ad2d13'} Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:07.388460 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. Jul 01 19:49:07.389759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:49:07.391055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] Returning 404 to user: Instance acd8c337-77a5-4fd0-aeef-555fb1ad2d13 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:07.391055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2e0c1279-4929-4d2c-8df1-ebf21bd8100d tempest-AttachVolumeTestJSON-522248157 tempest-AttachVolumeTestJSON-522248157-project] 10.222.0.61 "GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13" status: 404 len: 111 microversion: 2.1 time: 0.033162 Jul 01 19:49:07.391055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 518/1046] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:07 2022] GET /compute/v2.1/servers/acd8c337-77a5-4fd0-aeef-555fb1ad2d13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:39.451834 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1334418606", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:39.457539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:39.458218 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:39.507083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] validate_networks() for None {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:49:39.778610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:49:39.779025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:49:39.779488 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:49:39.779888 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:49:39.780290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:49:39.790629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:39.791069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:39.791852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:39.792282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:39.808765 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Getting quotas for project a26eae74001140bc85f0e80644ecfba9. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:49:39.812852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Getting quotas for user 60d4227c0bc444339d59f5b7a024454c and project a26eae74001140bc85f0e80644ecfba9. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:49:39.824452 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:49:39.826769 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:49:39.874654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6765013e-240f-426c-9a31-fdd764ee6771 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426601 Jul 01 19:49:39.875742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 529/1047] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:49:39.890373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-73c33360-0c27-404a-ad74-5506bbdb0daa tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:39.891099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-73c33360-0c27-404a-ad74-5506bbdb0daa tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:39.893075 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:39.893711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:39.949990 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-73c33360-0c27-404a-ad74-5506bbdb0daa tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:39.956878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-73c33360-0c27-404a-ad74-5506bbdb0daa tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1215 microversion: 2.1 time: 0.071568 Jul 01 19:49:39.957446 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 519/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:39 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:40.974979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:40.975578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:40.982264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:40.982846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:40.983622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:40.984058 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:41.051958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:41.060624 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9577679f-118d-42a5-88da-fc4ba54076d6 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1267 microversion: 2.1 time: 0.090063 Jul 01 19:49:41.061390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 530/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:40 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:42.079639 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:42.080814 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:42.087701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:42.088365 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:42.089150 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:42.089582 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:42.291670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:42.299838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c0ea7935-5f35-4210-b619-bf3a45a72a89 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.224055 Jul 01 19:49:42.300766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 520/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:42 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:42.856950 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-5b7d3e12-023b-4dcb-9d4d-0949518e28d9 req-cfadacbf-e666-4419-835a-ba68f72f9932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472ea375-71bf-49a2-9086-d1e4640d5161", "tag": "f82c2710-a96d-45fb-bf9b-e4346a39a4a8"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:42.866268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5b7d3e12-023b-4dcb-9d4d-0949518e28d9 req-cfadacbf-e666-4419-835a-ba68f72f9932 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:42.866745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5b7d3e12-023b-4dcb-9d4d-0949518e28d9 req-cfadacbf-e666-4419-835a-ba68f72f9932 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:42.879526 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-5b7d3e12-023b-4dcb-9d4d-0949518e28d9 req-cfadacbf-e666-4419-835a-ba68f72f9932 service nova] Creating event network-changed:f82c2710-a96d-45fb-bf9b-e4346a39a4a8 for instance 472ea375-71bf-49a2-9086-d1e4640d5161 on hv-cinder-83124 Jul 01 19:49:42.888616 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-5b7d3e12-023b-4dcb-9d4d-0949518e28d9 req-cfadacbf-e666-4419-835a-ba68f72f9932 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035897 Jul 01 19:49:42.890035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 531/1051] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:49:43.317472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:43.318032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:43.325377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:43.325800 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:43.326641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:43.327076 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:43.466462 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:43.474326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9a7c247b-4ec9-42d4-9165-703f50fe272f tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.160999 Jul 01 19:49:43.474892 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 521/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:43 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:44.497510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:44.498715 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:44.509514 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:44.510334 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:44.511598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:44.512317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:44.651963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:44.660489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a0216faa-c022-4f7b-bb2d-099983ae862a tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.170899 Jul 01 19:49:44.661055 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 532/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:44 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:45.680893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:45.681820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:45.690856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:45.691299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:45.692054 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:45.692477 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:45.825552 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:45.833163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b6e0b9e5-2d39-46c8-ac57-26c5a335b60b tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.158899 Jul 01 19:49:45.833731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 522/1054] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:45 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:46.236746 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:46.237272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:46.243376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:46.243815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:46.244568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:46.244990 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:46.268510 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cf5973ce-cca2-4e4c-bbff-c0d951fcc78f tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/ips" status: 200 len: 149 microversion: 2.1 time: 0.252018 Jul 01 19:49:46.269044 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 533/1055] 10.222.0.61 () {58 vars in 1247 bytes} [Fri Jul 1 19:49:46 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/ips => generated 149 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:49:46.850121 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:46.850734 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:46.857275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:46.857718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:46.858510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:46.858937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:46.990600 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:46.998199 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b9e21000-db93-4a27-8f01-817dad09b503 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.152166 Jul 01 19:49:46.998765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 523/1056] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:46 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:47.605029 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1bb88ac-6a3f-47fb-8a58-b7efaacc9fee"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:47.606251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:47.614519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:47.614979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:47.615754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:47.616191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:47.884937 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-be9d4600-6433-443f-98d8-9f86b4cc251e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "POST /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283902 Jul 01 19:49:47.885565 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 534/1057] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:49:47 2022] POST /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:49:48.018779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:48.019426 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:48.026439 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:48.026895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:48.027666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:48.028102 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:48.158192 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:48.169627 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4150baa3-0c7c-4f9d-b5b8-1cdb920bc397 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.157704 Jul 01 19:49:48.170449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 524/1058] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:48 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:48.893447 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-79410024-647e-45b9-b63a-d2f8e3c27b3b req-2a7e578f-fe48-49b5-aba1-09c7423a0cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472ea375-71bf-49a2-9086-d1e4640d5161", "name": "network-vif-plugged", "status": "completed", "tag": "f82c2710-a96d-45fb-bf9b-e4346a39a4a8"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:48.902625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-79410024-647e-45b9-b63a-d2f8e3c27b3b req-2a7e578f-fe48-49b5-aba1-09c7423a0cdb service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:48.903079 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-79410024-647e-45b9-b63a-d2f8e3c27b3b req-2a7e578f-fe48-49b5-aba1-09c7423a0cdb service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:48.914679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-79410024-647e-45b9-b63a-d2f8e3c27b3b req-2a7e578f-fe48-49b5-aba1-09c7423a0cdb service nova] Creating event network-vif-plugged:f82c2710-a96d-45fb-bf9b-e4346a39a4a8 for instance 472ea375-71bf-49a2-9086-d1e4640d5161 on hv-cinder-83124 Jul 01 19:49:48.919437 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-79410024-647e-45b9-b63a-d2f8e3c27b3b req-2a7e578f-fe48-49b5-aba1-09c7423a0cdb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030593 Jul 01 19:49:48.920190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 535/1059] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:49:49.187249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:49.187967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:49.195316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:49.195768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:49.196531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:49.196976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:49.330796 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:49.338382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f70f5da1-5b2e-452c-8709-ffa9eec224d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.155102 Jul 01 19:49:49.338996 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 525/1060] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:49 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:50.354126 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:50.355054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:50.360599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:50.361446 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:50.370589 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:50.371132 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:50.372108 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:50.372686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:50.515250 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:50.526537 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0fd4e897-dbc5-4440-ac80-88036ebc0448 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1315 microversion: 2.1 time: 0.173892 Jul 01 19:49:50.527297 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 536/1061] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:50 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:51.548215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:51.549130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:51.552165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:51.562327 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.563064 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.564446 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.564887 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.708903 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:51.718307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-432d7c32-2618-410f-81ac-c3009b7c80c4 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1465 microversion: 2.1 time: 0.176533 Jul 01 19:49:51.718872 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 526/1062] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:51 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:51.765563 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:51.766136 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:51.773061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.773521 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.774341 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.774783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.800639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:49:51.850918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:51.851896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:51.858137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.858589 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.859453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.859840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.884091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ae7c4e4b-2fd9-4326-8510-dda3d7e229a3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "DELETE /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 204 len: 0 microversion: 2.1 time: 0.122102 Jul 01 19:49:51.884905 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 537/1063] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:49:51 2022] DELETE /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:49:51.889895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-852ac93e-e285-4dcd-84fb-00f51719a51e tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042928 Jul 01 19:49:51.890494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 527/1064] 10.222.0.61 () {60 vars in 1342 bytes} [Fri Jul 1 19:49:51 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:49:51.893971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:51.894710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:51.901295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.901741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.902538 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.902970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.948485 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:51.948988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:51.955059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.955508 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.956278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:51.956713 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:51.982955 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:49:52.037566 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:52.046833 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9b188de5-1f25-4e06-bd99-3f7f03651568 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1471 microversion: 2.1 time: 0.157217 Jul 01 19:49:52.047405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 538/1065] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:51 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:49:52.068618 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7037dd7f-b4fd-4bf0-a50d-36a29275e594 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 204 len: 0 microversion: 2.20 time: 0.123699 Jul 01 19:49:52.069231 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 528/1066] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jul 1 19:49:51 2022] DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 19:49:52.077545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:52.078186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:52.084375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:52.084821 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:52.085590 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:52.086052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:52.220251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:52.228677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:52.230192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:52.231361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a3e3ca3b-ea7f-4000-97f4-56b449f37ad5 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.157767 Jul 01 19:49:52.231920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 539/1067] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:49:52 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:49:53.066824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:53.067579 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:53.074856 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:53.075309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:53.076111 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:53.076549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:53.208510 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:53.216809 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-484da57a-8cb7-4b38-89a7-85b1da34ee40 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1471 microversion: 2.1 time: 0.154372 Jul 01 19:49:53.218128 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 529/1068] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:53 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:53.251239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:53.251891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:53.258600 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:53.259049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:53.259814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:53.260249 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:53.396331 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:53.404925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:53.406461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:53.407638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-45dcbfda-c68d-4058-b080-114fdff7f184 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.160468 Jul 01 19:49:53.408203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 540/1069] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:49:53 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:49:54.237762 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:54.239024 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:54.245932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:54.246408 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:54.247178 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:54.247611 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:54.381091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:54.388996 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9d9d214d-7121-4920-a7d2-b8c2a0f351d3 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1471 microversion: 2.1 time: 0.157835 Jul 01 19:49:54.389582 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 530/1070] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:54 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:54.426159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:54.426818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:54.433786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:54.434278 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:54.435041 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:54.435485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:54.580276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:54.592693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:54.594920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:54.596700 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4bcb4311-d54f-44dc-8680-727a55022144 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.174243 Jul 01 19:49:54.597408 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 541/1071] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:49:54 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:49:55.407208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:55.407840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:55.415029 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:55.415488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:55.416292 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:55.416731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:55.621825 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:55.622701 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:55.623686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d4227c0bc444339d59f5b7a024454c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26eae74001140bc85f0e80644ecfba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:55.635621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b50271b0-b065-428c-b87f-bb0a4ed461b8 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 200 len: 1471 microversion: 2.1 time: 0.229814 Jul 01 19:49:55.636181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:55.636976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:55.637977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:55.638684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:55.647387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 531/1072] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:55 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:55.876426 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:55.892840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:55.892840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:55.892840 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aab5765b-e522-4a98-894c-fc3ebc313528 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1722 microversion: 2.20 time: 0.276016 Jul 01 19:49:55.896436 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 542/1073] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:49:55 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:49:55.934697 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-e1c1bde8-7be5-45e5-b8c7-ce3e126d9ae6 req-1508abe4-a573-4562-9759-5e9772d33f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472ea375-71bf-49a2-9086-d1e4640d5161", "name": "network-vif-deleted", "tag": "f82c2710-a96d-45fb-bf9b-e4346a39a4a8"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:55.951386 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e1c1bde8-7be5-45e5-b8c7-ce3e126d9ae6 req-1508abe4-a573-4562-9759-5e9772d33f15 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:55.952034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e1c1bde8-7be5-45e5-b8c7-ce3e126d9ae6 req-1508abe4-a573-4562-9759-5e9772d33f15 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:55.966118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-e1c1bde8-7be5-45e5-b8c7-ce3e126d9ae6 req-1508abe4-a573-4562-9759-5e9772d33f15 service nova] Creating event network-vif-deleted:f82c2710-a96d-45fb-bf9b-e4346a39a4a8 for instance 472ea375-71bf-49a2-9086-d1e4640d5161 on hv-cinder-83124 Jul 01 19:49:55.971572 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-e1c1bde8-7be5-45e5-b8c7-ce3e126d9ae6 req-1508abe4-a573-4562-9759-5e9772d33f15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140525 Jul 01 19:49:55.972422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 532/1074] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:49:56.410855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a24530ab-61c7-4d7b-80de-2d77967e48b2 req-8776b73e-c448-4bac-a3fa-781932ba3220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6319e331-4ca0-42c3-887a-900720c79f78", "name": "network-vif-deleted", "tag": "843fb392-acd9-492d-b960-e5c938591ec5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:49:56.424976 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a24530ab-61c7-4d7b-80de-2d77967e48b2 req-8776b73e-c448-4bac-a3fa-781932ba3220 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.425355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a24530ab-61c7-4d7b-80de-2d77967e48b2 req-8776b73e-c448-4bac-a3fa-781932ba3220 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.445457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a24530ab-61c7-4d7b-80de-2d77967e48b2 req-8776b73e-c448-4bac-a3fa-781932ba3220 service nova] Creating event network-vif-deleted:843fb392-acd9-492d-b960-e5c938591ec5 for instance 6319e331-4ca0-42c3-887a-900720c79f78 on hv-cinder-83124 Jul 01 19:49:56.450868 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-a24530ab-61c7-4d7b-80de-2d77967e48b2 req-8776b73e-c448-4bac-a3fa-781932ba3220 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043681 Jul 01 19:49:56.454116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 543/1075] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:49:56.598746 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:56.599389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:56.606322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.607165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.608170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.608820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.654930 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:56.657596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] [instance: 472ea375-71bf-49a2-9086-d1e4640d5161] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:56.671284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.672016 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.672994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.673634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.692092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] HTTP exception thrown: Instance 472ea375-71bf-49a2-9086-d1e4640d5161 could not be found. Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Request method failure captured: Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 HTTP/1.1 Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv0_Rmp-frLzPyk7WjGf91LVqpS0cKg5c8arqi21EWA4mAt2A4_T8OBJ9L_6V7JWwNB80UeOsGCrbzVhBGos3-8rmtyOPbH1hjm3ZzhZnJScWwAFw_PQcU40RKwAVi6xAW2pEy4PyxUf-o8j_cODdr8oCRmgGRPBpRu5roEGzuvcXF9Y Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: a26eae74001140bc85f0e80644ecfba9 Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-353939056 Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:49:56.694213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a26eae74001140bc85f0e80644ecfba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a26eae74001140bc85f0e80644ecfba9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a26eae74001140bc85f0e80644ecfba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a26eae74001140bc85f0e80644ecfba9", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-353939056 Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: a26eae74001140bc85f0e80644ecfba9 Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-353939056 Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-353939056-project Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 60d4227c0bc444339d59f5b7a024454c Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-353939056-project Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 472ea375-71bf-49a2-9086-d1e4640d5161 could not be found. Jul 01 19:49:56.695854 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '472ea375-71bf-49a2-9086-d1e4640d5161'} Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472ea375-71bf-49a2-9086-d1e4640d5161 could not be found. Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:56.696997 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472ea375-71bf-49a2-9086-d1e4640d5161 could not be found. Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472ea375-71bf-49a2-9086-d1e4640d5161 could not be found. Jul 01 19:49:56.701264 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:56.703837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] Returning 404 to user: Instance 472ea375-71bf-49a2-9086-d1e4640d5161 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:56.703837 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5abfc58b-9088-4167-a9ae-1ee3d56fe229 tempest-VolumesNegativeTest-353939056 tempest-VolumesNegativeTest-353939056-project] 10.222.0.61 "GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161" status: 404 len: 111 microversion: 2.1 time: 0.045264 Jul 01 19:49:56.708690 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'services' on Instance uuid 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:49:56.711732 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 544/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:56 2022] GET /compute/v2.1/servers/472ea375-71bf-49a2-9086-d1e4640d5161 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:49:56.803789 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4aea12ce-3991-4fa0-a944-fee1b00d4dfa tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments/a1bb88ac-6a3f-47fb-8a58-b7efaacc9fee" status: 202 len: 0 microversion: 2.1 time: 0.209172 Jul 01 19:49:56.807844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 533/1077] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:49:56 2022] DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments/a1bb88ac-6a3f-47fb-8a58-b7efaacc9fee => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:49:56.814114 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:56.815289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:56.822741 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.823470 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.824386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.825225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.858816 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6e2574aa-c5e1-4161-ad9f-0fae82ae8794 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049593 Jul 01 19:49:56.859693 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 545/1078] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:49:56 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:49:56.912343 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:56.913295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:56.922284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.923057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.924769 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.925425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.971415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:56.971924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:56.972518 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lazy-loading 'fault' on Instance uuid 6319e331-4ca0-42c3-887a-900720c79f78 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:49:56.983548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:57.029274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:57.038329 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:57.040187 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5040520134e464ea1d534767ea8728e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc18901e30b4252988c065baa36be3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:57.041583 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-64e954f6-b001-4f04-bf6c-1f5d69dec028 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 200 len: 1371 microversion: 2.20 time: 0.134335 Jul 01 19:49:57.042356 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 534/1079] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:49:56 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 1371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:49:57.871090 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:57.872220 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:57.881276 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:57.881717 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:57.882496 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:57.882919 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:57.886743 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:57.916841 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c36bd5c6-2aa5-42f4-b229-08580569fce1 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050236 Jul 01 19:49:57.917430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 546/1080] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:49:57 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:49:57.980790 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:57.981456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:57.988129 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:57.988555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:57.989379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:57.989875 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:58.015642 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:49:58.062321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:58.064582 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:58.071627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:58.072054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:58.072859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:58.073391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:58.087867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] HTTP exception thrown: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Request method failure captured: Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 HTTP/1.1 Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv00_qQtwd8knoeezfJHZdyP7qhHUX3oGpQAFhr2VNBGjlTDYV2gmOox3dnpfzZ9Cut9TGmcu9zF5QztxgwZXuw-3nZCpRMVI0M8B_TBEZRgIx4uQ1NldtnGtq5tf1d76yemVofqYaMIzeihQ4yuEbIJ1MQIeNL0AIbp29Bc7jIQmkog Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:49:58.090317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9bc18901e30b4252988c065baa36be3c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: b5040520134e464ea1d534767ea8728e Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:49:58.092062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '6319e331-4ca0-42c3-887a-900720c79f78'} Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:49:58.093179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:49:58.094739 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:49:58.096061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Returning 404 to user: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:49:58.096061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f2984ab-ffe8-4bb5-be63-d2c8f09dceea tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 404 len: 111 microversion: 2.20 time: 0.036762 Jul 01 19:49:58.096061 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 547/1081] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:49:58 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 19:49:58.103344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7a407296-cdfe-4c8e-a7b5-a22249167f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '.version_select at 0x7f4764830280>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:58.111167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-460f1275-aa79-4702-b108-d36eaced5001 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 204 len: 0 microversion: 2.1 time: 0.133249 Jul 01 19:49:58.113984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 535/1082] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:49:57 2022] DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:49:58.123169 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:58.123622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7a407296-cdfe-4c8e-a7b5-a22249167f96 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112116052" status: 204 len: 0 microversion: 2.20 time: 0.023912 Jul 01 19:49:58.124039 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:58.124225 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 548/1083] 10.222.0.61 () {60 vars in 1261 bytes} [Fri Jul 1 19:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112116052 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 19:49:58.133917 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:58.134562 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:58.135415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:58.135878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:58.323015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:58.335658 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be47e6db-3b12-4315-82e8-f8c50d8a92dd tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1679 microversion: 2.1 time: 0.218349 Jul 01 19:49:58.336563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 536/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:58 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:49:59.354353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:49:59.354956 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:49:59.364267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:59.364267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:59.364267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:49:59.364267 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:49:59.507767 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:49:59.515272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3c1406a5-2e86-4cdc-bf50-7b6f0418de7b tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1679 microversion: 2.1 time: 0.165401 Jul 01 19:49:59.515867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 549/1085] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:49:59 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:00.001608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:00.002131 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:00.008842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:00.009293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:00.010063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:00.010499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:00.024217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] HTTP exception thrown: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Request method failure captured: Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 HTTP/1.1 Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00_qQtwd8knoeezfJHZdyP7qhHUX3oGpQAFhr2VNBGjlTDYV2gmOox3dnpfzZ9Cut9TGmcu9zF5QztxgwZXuw-3nZCpRMVI0M8B_TBEZRgIx4uQ1NldtnGtq5tf1d76yemVofqYaMIzeihQ4yuEbIJ1MQIeNL0AIbp29Bc7jIQmkog Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:50:00.025878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9bc18901e30b4252988c065baa36be3c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: b5040520134e464ea1d534767ea8728e Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.027524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '6319e331-4ca0-42c3-887a-900720c79f78'} Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:00.028574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.030072 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.031635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Returning 404 to user: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:00.031635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6daec927-3f35-4b25-b8ec-81e941c21a1b tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 404 len: 111 microversion: 2.20 time: 0.029628 Jul 01 19:50:00.031635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 537/1086] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jul 1 19:49:59 2022] DELETE /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:50:00.035954 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:00.036557 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: 6319e331-4ca0-42c3-887a-900720c79f78] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:00.042980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:00.043424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:00.044208 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:00.044667 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:00.060092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] HTTP exception thrown: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Request method failure captured: Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 HTTP/1.1 Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv00_qQtwd8knoeezfJHZdyP7qhHUX3oGpQAFhr2VNBGjlTDYV2gmOox3dnpfzZ9Cut9TGmcu9zF5QztxgwZXuw-3nZCpRMVI0M8B_TBEZRgIx4uQ1NldtnGtq5tf1d76yemVofqYaMIzeihQ4yuEbIJ1MQIeNL0AIbp29Bc7jIQmkog Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:00.061786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9bc18901e30b4252988c065baa36be3c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: b5040520134e464ea1d534767ea8728e Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.063366 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '6319e331-4ca0-42c3-887a-900720c79f78'} Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:00.064410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. Jul 01 19:50:00.065872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:00.067424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Returning 404 to user: Instance 6319e331-4ca0-42c3-887a-900720c79f78 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:00.067424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fe078527-dea8-401d-b1c5-fa7c319b9a20 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78" status: 404 len: 111 microversion: 2.20 time: 0.031166 Jul 01 19:50:00.067424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 550/1087] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:50:00 2022] GET /compute/v2.1/servers/6319e331-4ca0-42c3-887a-900720c79f78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 19:50:00.533084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:00.533725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:00.541249 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:00.541695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:00.542570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:00.543032 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:00.681827 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:00.691015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-91b25867-8638-435c-a974-f9743d63452e tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1679 microversion: 2.1 time: 0.161958 Jul 01 19:50:00.691898 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 538/1088] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:00 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:01.217074 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:01.218412 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:01.226850 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.227153 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.227956 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.228368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.251518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] HTTP exception thrown: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Request method failure captured: Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 HTTP/1.1 Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv00_qQtwd8knoeezfJHZdyP7qhHUX3oGpQAFhr2VNBGjlTDYV2gmOox3dnpfzZ9Cut9TGmcu9zF5QztxgwZXuw-3nZCpRMVI0M8B_TBEZRgIx4uQ1NldtnGtq5tf1d76yemVofqYaMIzeihQ4yuEbIJ1MQIeNL0AIbp29Bc7jIQmkog Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:01.253183 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9bc18901e30b4252988c065baa36be3c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: b5040520134e464ea1d534767ea8728e Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.254660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'fc929a10-068e-444f-bc59-ab78f9821237'} Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:01.255639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.256915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.260052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Returning 404 to user: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:01.269712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b9904356-295f-4de9-b108-d988f7881b11 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 404 len: 111 microversion: 2.20 time: 0.056628 Jul 01 19:50:01.270622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 551/1089] 10.222.0.61 () {60 vars in 1279 bytes} [Fri Jul 1 19:50:01 2022] DELETE /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:50:01.278384 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:01.279633 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] [instance: fc929a10-068e-444f-bc59-ab78f9821237] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:01.288243 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.298371 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.299341 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.299776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.325848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] HTTP exception thrown: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Request method failure captured: Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 HTTP/1.1 Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv00_qQtwd8knoeezfJHZdyP7qhHUX3oGpQAFhr2VNBGjlTDYV2gmOox3dnpfzZ9Cut9TGmcu9zF5QztxgwZXuw-3nZCpRMVI0M8B_TBEZRgIx4uQ1NldtnGtq5tf1d76yemVofqYaMIzeihQ4yuEbIJ1MQIeNL0AIbp29Bc7jIQmkog Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:50:01.327904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9bc18901e30b4252988c065baa36be3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9bc18901e30b4252988c065baa36be3c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9bc18901e30b4252988c065baa36be3c Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-613779758 Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: b5040520134e464ea1d534767ea8728e Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-613779758-project Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.329548 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'fc929a10-068e-444f-bc59-ab78f9821237'} Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:01.330463 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. Jul 01 19:50:01.332055 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:01.336467 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] Returning 404 to user: Instance fc929a10-068e-444f-bc59-ab78f9821237 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:01.338170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5d95a2e4-b4c8-4f5f-8c84-b459c29a55c3 tempest-AttachVolumeShelveTestJSON-613779758 tempest-AttachVolumeShelveTestJSON-613779758-project] 10.222.0.61 "GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237" status: 404 len: 111 microversion: 2.20 time: 0.063637 Jul 01 19:50:01.339276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 539/1090] 10.222.0.61 () {60 vars in 1276 bytes} [Fri Jul 1 19:50:01 2022] GET /compute/v2.1/servers/fc929a10-068e-444f-bc59-ab78f9821237 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 19:50:01.482915 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-b74ceb45-40e9-444f-a2ca-1f8403bfb8c1 req-fb4bd0d9-4c9d-4e67-935c-42e88b12a620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55633a59-8bc6-45d2-9e57-97fd1bdb3eb8", "name": "network-vif-deleted", "tag": "ef645cf1-5a26-4b7f-a6fb-475af444f8d9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:50:01.493859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b74ceb45-40e9-444f-a2ca-1f8403bfb8c1 req-fb4bd0d9-4c9d-4e67-935c-42e88b12a620 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.494602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b74ceb45-40e9-444f-a2ca-1f8403bfb8c1 req-fb4bd0d9-4c9d-4e67-935c-42e88b12a620 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.521884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-b74ceb45-40e9-444f-a2ca-1f8403bfb8c1 req-fb4bd0d9-4c9d-4e67-935c-42e88b12a620 service nova] Creating event network-vif-deleted:ef645cf1-5a26-4b7f-a6fb-475af444f8d9 for instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 on hv-cinder-83124 Jul 01 19:50:01.528497 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-b74ceb45-40e9-444f-a2ca-1f8403bfb8c1 req-fb4bd0d9-4c9d-4e67-935c-42e88b12a620 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 Jul 01 19:50:01.529762 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 552/1091] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:50:01.708723 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:01.709338 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:01.716085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.716804 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.718449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.719120 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.759450 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:01.760109 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:01.760662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lazy-loading 'fault' on Instance uuid 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:50:01.816648 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3229929e0f2f4c9fbb3dc6413b6db151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d037922bcac4bc6babcd8183982073e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:01.824683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6ddba391-5718-46ac-994c-1cbfd4b0c4bc tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 200 len: 1332 microversion: 2.1 time: 0.119958 Jul 01 19:50:01.825702 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 540/1092] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:01 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:02.842523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:02.843179 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:02.850203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:02.850650 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:02.851485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:02.851924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:02.865912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 HTTP/1.1 Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:02.867592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:02.869002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '55633a59-8bc6-45d2-9e57-97fd1bdb3eb8'} Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:02.869745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:02.871028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:02.872167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:02.872167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e6cc81c-defd-42ab-896b-910520c0562d tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 404 len: 111 microversion: 2.1 time: 0.031018 Jul 01 19:50:02.872167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 553/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:02 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:02.878499 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c1fb7edb-b935-4a78-98a7-016611580353 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '.version_select at 0x7f47646ac0d0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:02.900177 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c1fb7edb-b935-4a78-98a7-016611580353 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553970768" status: 202 len: 0 microversion: 2.1 time: 0.025678 Jul 01 19:50:02.900766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 541/1094] 10.222.0.61 () {58 vars in 1220 bytes} [Fri Jul 1 19:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553970768 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:50:04.828009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:04.828580 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:04.835978 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:04.836314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:04.837103 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:04.837534 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:04.851855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 HTTP/1.1 Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:04.853552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.855325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '55633a59-8bc6-45d2-9e57-97fd1bdb3eb8'} Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:04.856299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.857897 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.859449 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:04.859939 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-75af9fa1-6a12-4ad8-8287-ce4beebf1fb6 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 404 len: 111 microversion: 2.1 time: 0.035162 Jul 01 19:50:04.860491 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 554/1095] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:50:04 2022] DELETE /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:04.874349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:04.874349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:04.879010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:04.879466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:04.880251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:04.880687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:04.895084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 HTTP/1.1 Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:50:04.896655 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.898287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '55633a59-8bc6-45d2-9e57-97fd1bdb3eb8'} Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:04.899214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. Jul 01 19:50:04.900751 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:04.902379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance 55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:04.902379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-28958630-75a0-495c-bafb-0d95df3007be tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8" status: 404 len: 111 microversion: 2.1 time: 0.033353 Jul 01 19:50:04.902379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 542/1096] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:04 2022] GET /compute/v2.1/servers/55633a59-8bc6-45d2-9e57-97fd1bdb3eb8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:05.311916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1299755279", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "networks": [{"uuid": "542dcdb0-c7a6-4b66-9867-c067f0604915"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:50:05.376233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] validate_networks() for [('542dcdb0-c7a6-4b66-9867-c067f0604915', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:50:05.760082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:50:05.760506 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:50:05.760975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:50:05.761388 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:50:05.761797 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:50:05.770781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:05.771170 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:05.771968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:05.772402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:05.790141 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Getting quotas for project d13ae3749c0f4f9e80ae0403b41d6b4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:50:05.794217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Getting quotas for user 9273538810d24fe19acf7c8e190e6dfe and project d13ae3749c0f4f9e80ae0403b41d6b4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:50:05.805148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:50:05.807450 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:50:05.852512 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-60a57293-3135-4d21-8bf8-f6d3b7e7cc78 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545469 Jul 01 19:50:05.858101 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 555/1097] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:50:05.863091 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d337a33c-f01f-4c66-b6bb-26fe487edc94 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:05.863704 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d337a33c-f01f-4c66-b6bb-26fe487edc94 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:05.929452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d337a33c-f01f-4c66-b6bb-26fe487edc94 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:05.936998 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d337a33c-f01f-4c66-b6bb-26fe487edc94 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1219 microversion: 2.1 time: 0.077703 Jul 01 19:50:05.937563 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 543/1098] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:05 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:06.099057 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:06.100685 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:06.108103 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.108616 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.109588 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.110203 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.124777 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 HTTP/1.1 Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:06.126415 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.128003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'be86e9b5-d5ca-4775-ba1b-041e6031db62'} Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:06.129243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.130814 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.132665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:06.132665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-89d713f7-551b-4baa-b4e3-81f8bf864ff5 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 404 len: 111 microversion: 2.1 time: 0.034687 Jul 01 19:50:06.132665 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 556/1099] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:50:06 2022] DELETE /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:06.136540 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:06.137147 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: be86e9b5-d5ca-4775-ba1b-041e6031db62] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:06.144391 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.145482 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.145635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.146115 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.160687 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 HTTP/1.1 Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:50:06.162364 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.164096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'be86e9b5-d5ca-4775-ba1b-041e6031db62'} Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:06.165059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. Jul 01 19:50:06.166599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.168456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance be86e9b5-d5ca-4775-ba1b-041e6031db62 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:06.168456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1946cd94-868e-440d-8d90-8a870035eb87 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62" status: 404 len: 111 microversion: 2.1 time: 0.031365 Jul 01 19:50:06.168456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 544/1100] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:06 2022] GET /compute/v2.1/servers/be86e9b5-d5ca-4775-ba1b-041e6031db62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:06.175598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:06.176100 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:06.184861 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.185314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.186123 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.186560 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.201138 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a HTTP/1.1 Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:06.202745 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.204165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '207060e8-4e36-4563-8fb9-54b21a39db6a'} Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:06.206645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.208165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.209458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:06.209458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0f795f66-48a7-4ad9-8ee8-046d90517d16 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 404 len: 111 microversion: 2.1 time: 0.033164 Jul 01 19:50:06.209458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 557/1101] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:50:06 2022] DELETE /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:06.213847 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:06.214572 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: 207060e8-4e36-4563-8fb9-54b21a39db6a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:06.221080 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.221605 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.222502 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.223122 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.237835 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a HTTP/1.1 Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:50:06.239449 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.241062 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '207060e8-4e36-4563-8fb9-54b21a39db6a'} Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:06.242619 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. Jul 01 19:50:06.244217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:06.245430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance 207060e8-4e36-4563-8fb9-54b21a39db6a could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:06.245430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-89dec469-2dbb-4793-a4ed-0fdf8db58a96 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a" status: 404 len: 111 microversion: 2.1 time: 0.031651 Jul 01 19:50:06.245430 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 545/1102] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:06 2022] GET /compute/v2.1/servers/207060e8-4e36-4563-8fb9-54b21a39db6a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:06.955943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:06.957201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:06.964653 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.965239 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:06.966131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:06.966553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:07.055923 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:07.064214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-41170a21-c6f3-45ed-a9a9-405e3d575925 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1289 microversion: 2.1 time: 0.113786 Jul 01 19:50:07.064859 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 558/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:06 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:07.401392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:07.401991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:07.409185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:07.409466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:07.410264 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:07.410711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:07.424921 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c HTTP/1.1 Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:50:07.426776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.428411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'b46dff9c-709e-4bb6-b3ee-d2247114ec8c'} Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:07.429349 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.430954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.432435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:07.432936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-72fd09fc-5312-4b6c-9f6c-2f9603e5e1b8 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 404 len: 111 microversion: 2.1 time: 0.035765 Jul 01 19:50:07.433715 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 546/1104] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:50:07 2022] DELETE /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:07.444028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:07.445385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] [instance: b46dff9c-709e-4bb6-b3ee-d2247114ec8c] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:07.454226 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:07.454896 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:07.455832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:07.456459 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:07.473396 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] HTTP exception thrown: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Request method failure captured: Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c HTTP/1.1 Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv000_hhqOLL0FBQMqLlSgE2SSPNSc7hTWx69ml_1bHsIk0Trj8oxNJuMzhSpN8Se1x65JnVYSm_SKd11PeFkNR9FmxJtHholp6dneIvjuJW07V-sTWvzZ9Ckmqx7fQi07f4C0WVGSrzafCNc4frnDHsAoetMBxC-2bPLkKH6hc7viWg Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:50:07.475495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d037922bcac4bc6babcd8183982073e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d037922bcac4bc6babcd8183982073e", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 7d037922bcac4bc6babcd8183982073e Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-335753923 Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 3229929e0f2f4c9fbb3dc6413b6db151 Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-335753923-project Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.477049 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'b46dff9c-709e-4bb6-b3ee-d2247114ec8c'} Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:50:07.477979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. Jul 01 19:50:07.479456 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:50:07.481585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] Returning 404 to user: Instance b46dff9c-709e-4bb6-b3ee-d2247114ec8c could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:50:07.482679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e63d3ba4-7ca2-4276-abb5-7e6136b0fd99 tempest-AttachVolumeNegativeTest-335753923 tempest-AttachVolumeNegativeTest-335753923-project] 10.222.0.61 "GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c" status: 404 len: 111 microversion: 2.1 time: 0.044234 Jul 01 19:50:07.483423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 559/1105] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:07 2022] GET /compute/v2.1/servers/b46dff9c-709e-4bb6-b3ee-d2247114ec8c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:08.084258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:08.085216 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:08.091553 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:08.092325 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:08.093230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:08.093758 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:08.322255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:08.330076 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e9cf9fec-fc82-4812-81a5-b76a7ead5a1e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.249737 Jul 01 19:50:08.330812 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 547/1106] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:08 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:08.533145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-1fc4d55f-05e7-47ef-8018-6818c3d0861f req-76aca8dc-a840-4fab-81a5-10bbd91d0c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22808e9-0efe-4047-bede-233081ef44e2", "tag": "642546b9-4529-4a9c-abb1-d3735b16c869"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:50:08.543559 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:08.550361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-1fc4d55f-05e7-47ef-8018-6818c3d0861f req-76aca8dc-a840-4fab-81a5-10bbd91d0c5d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:08.552884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-1fc4d55f-05e7-47ef-8018-6818c3d0861f req-76aca8dc-a840-4fab-81a5-10bbd91d0c5d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:08.570313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-1fc4d55f-05e7-47ef-8018-6818c3d0861f req-76aca8dc-a840-4fab-81a5-10bbd91d0c5d service nova] Creating event network-changed:642546b9-4529-4a9c-abb1-d3735b16c869 for instance e22808e9-0efe-4047-bede-233081ef44e2 on hv-cinder-83124 Jul 01 19:50:08.577548 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-1fc4d55f-05e7-47ef-8018-6818c3d0861f req-76aca8dc-a840-4fab-81a5-10bbd91d0c5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049936 Jul 01 19:50:08.579384 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 560/1107] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:50:09.348140 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:09.349009 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:09.355299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:09.355874 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:09.356914 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:09.357446 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:09.657671 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:09.666973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ca2a6e49-a7d7-492b-9cae-a9c6697b12b8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.323148 Jul 01 19:50:09.667551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 548/1108] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:09 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:10.685782 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:10.686596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:10.706622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:10.708090 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:10.710187 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:10.712780 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:11.006314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:11.016977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-425e3987-e571-4480-b9af-82f8029211dd tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.336475 Jul 01 19:50:11.021691 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 561/1109] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:10 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:12.042971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:12.043406 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:12.046805 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:12.053609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:12.054172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:12.055083 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:12.055876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:12.243166 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:12.252203 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4715315c-bfa8-4331-8b48-3c02c79ff77b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.213613 Jul 01 19:50:12.252900 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 549/1110] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:12 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:13.271756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:13.272464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:13.279471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:13.279925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:13.280689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:13.281127 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:13.436733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:13.446819 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-81f58cc2-74a5-4be5-97dc-4eff33010d48 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.180048 Jul 01 19:50:13.447666 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 562/1111] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:13 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:14.464171 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:14.464776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:14.471407 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:14.471981 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:14.472743 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:14.473183 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:14.625488 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:14.634688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-808711de-c00e-472f-accb-89fef4b0d3ff tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.174259 Jul 01 19:50:14.635661 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 550/1112] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:14 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:15.056820 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d02d1a71-3688-429a-a125-f5959cc0f780 req-075ea605-777f-404e-8e3e-1d9cbb406af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22808e9-0efe-4047-bede-233081ef44e2", "name": "network-vif-plugged", "status": "completed", "tag": "642546b9-4529-4a9c-abb1-d3735b16c869"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:50:15.066515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d02d1a71-3688-429a-a125-f5959cc0f780 req-075ea605-777f-404e-8e3e-1d9cbb406af9 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:15.067099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d02d1a71-3688-429a-a125-f5959cc0f780 req-075ea605-777f-404e-8e3e-1d9cbb406af9 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:15.081244 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d02d1a71-3688-429a-a125-f5959cc0f780 req-075ea605-777f-404e-8e3e-1d9cbb406af9 service nova] Creating event network-vif-plugged:642546b9-4529-4a9c-abb1-d3735b16c869 for instance e22808e9-0efe-4047-bede-233081ef44e2 on hv-cinder-83124 Jul 01 19:50:15.086405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d02d1a71-3688-429a-a125-f5959cc0f780 req-075ea605-777f-404e-8e3e-1d9cbb406af9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034066 Jul 01 19:50:15.087184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 563/1113] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:50:15.652164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:15.653469 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:15.660169 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:15.660618 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:15.661403 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:15.661820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:15.800491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:15.808682 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d3aa2aac-8c3f-4784-bbcf-5876a9c73e16 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.160770 Jul 01 19:50:15.809248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 551/1114] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:15 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:16.825598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:16.826307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:16.828364 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:16.829067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:16.835647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:16.836121 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:16.836881 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:16.837313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:16.971956 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:16.979952 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bd98bc89-0546-4fd5-bb35-83431ab71b3c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.158588 Jul 01 19:50:16.980556 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 564/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:16 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:18.000822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:18.001818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:18.004680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:18.012525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:18.012973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:18.013726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:18.014190 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:18.151570 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:18.159355 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-afe6c756-efa7-4067-aa5a-5a169d95dba4 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1319 microversion: 2.1 time: 0.165119 Jul 01 19:50:18.159913 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 552/1116] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:17 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:19.180716 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:19.181654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:19.189073 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:19.189549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:19.190403 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:19.190863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:19.325209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:50:19.336151 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-40383a06-3691-43b8-8656-64a57f5f814a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1508 microversion: 2.1 time: 0.161854 Jul 01 19:50:19.336916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 565/1117] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:50:19 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:50:54.682958 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2260ce76-4fdc-4cbb-b768-508681eb5d85", "device": "/dev/sdb"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:50:54.684590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:50:54.686764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=7 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:54.687464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:54.693970 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:54.694697 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:54.695500 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:54.695946 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:54.957853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-26ed14a3-a6be-475f-8545-cea67cac9f53 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "POST /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278806 Jul 01 19:50:54.958692 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 553/1118] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:50:54 2022] POST /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:51:36.339924 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:36.340667 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=64 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:36.344938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:51:36.345507 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:51:36.352375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:36.352813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:36.353567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:36.354018 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:36.436343 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lazy-loading 'services' on Instance uuid e22808e9-0efe-4047-bede-233081ef44e2 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:51:36.511524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-60295a50-5983-479b-ab47-14683d012519 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2/os-volume_attachments/2260ce76-4fdc-4cbb-b768-508681eb5d85" status: 202 len: 0 microversion: 2.1 time: 0.173209 Jul 01 19:51:36.512273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 566/1119] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:51:36 2022] DELETE /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2/os-volume_attachments/2260ce76-4fdc-4cbb-b768-508681eb5d85 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:51:37.626830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:37.627664 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:37.632695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:51:37.633793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:51:37.641750 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:37.642214 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:37.642979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:37.643404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:37.669014 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:51:37.747966 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-479c6ed0-5566-4471-924f-96de4ccd6605 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 204 len: 0 microversion: 2.1 time: 0.122398 Jul 01 19:51:37.751737 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 554/1120] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:51:37 2022] DELETE /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:51:37.758107 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:51:37.758832 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:51:37.765213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:37.765723 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:37.766569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:37.767197 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:37.922932 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:51:37.933410 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-444533b6-798e-406f-93ab-4f350228e265 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1514 microversion: 2.1 time: 0.180133 Jul 01 19:51:37.934386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 567/1121] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:51:37 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:51:38.951596 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:51:38.952163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:51:38.958651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:38.959097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:38.959861 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:38.960341 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:39.100035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:51:39.108544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-778749d7-dbd7-4fcf-8d3d-962a53e36e33 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1514 microversion: 2.1 time: 0.161210 Jul 01 19:51:39.109255 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 555/1122] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:51:38 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:51:40.125963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:51:40.127342 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:51:40.133770 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:40.134238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:40.135205 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:40.135771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:40.294342 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:51:40.307661 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-76ac5e50-55c0-4004-9cdb-cc2f3019591c tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 200 len: 1514 microversion: 2.1 time: 0.185145 Jul 01 19:51:40.308705 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 568/1123] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:51:40 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:51:40.620086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-3e87172c-d9f4-410d-acdc-4f75e90d99fa req-60064ee0-0fdc-4e7f-833d-4b099b328c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22808e9-0efe-4047-bede-233081ef44e2", "name": "network-vif-deleted", "tag": "642546b9-4529-4a9c-abb1-d3735b16c869"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:51:40.628855 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-3e87172c-d9f4-410d-acdc-4f75e90d99fa req-60064ee0-0fdc-4e7f-833d-4b099b328c1c service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:40.629320 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-3e87172c-d9f4-410d-acdc-4f75e90d99fa req-60064ee0-0fdc-4e7f-833d-4b099b328c1c service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:40.641116 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-3e87172c-d9f4-410d-acdc-4f75e90d99fa req-60064ee0-0fdc-4e7f-833d-4b099b328c1c service nova] Creating event network-vif-deleted:642546b9-4529-4a9c-abb1-d3735b16c869 for instance e22808e9-0efe-4047-bede-233081ef44e2 on hv-cinder-83124 Jul 01 19:51:40.646310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-3e87172c-d9f4-410d-acdc-4f75e90d99fa req-60064ee0-0fdc-4e7f-833d-4b099b328c1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327998 Jul 01 19:51:40.647093 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 556/1124] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:51:41.325864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:51:41.326511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: e22808e9-0efe-4047-bede-233081ef44e2] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:51:41.333268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:41.333724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:41.334521 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:41.335064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:41.348677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] HTTP exception thrown: Instance e22808e9-0efe-4047-bede-233081ef44e2 could not be found. Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Request method failure captured: Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 HTTP/1.1 Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv0_rVhKHLRFbh9pkmxE2WJKhB4h9ZvZ3jIFsJaN30eY01YNcelihTVjp5qSE44JCWsRcD80pGjuyD-SJ4VLlRAjTVoCV0tog4DsoBgRDNTmjXSVHT5ITEXoIhL715_0tOnisvtptq1FdgrDWL50A9ttYrDyXC_2syTJQkN7TxR6k7pc Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: d13ae3749c0f4f9e80ae0403b41d6b4c Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotTestJSON-933560305 Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:51:41.350386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d13ae3749c0f4f9e80ae0403b41d6b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d13ae3749c0f4f9e80ae0403b41d6b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d13ae3749c0f4f9e80ae0403b41d6b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d13ae3749c0f4f9e80ae0403b41d6b4c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotTestJSON-933560305 Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: d13ae3749c0f4f9e80ae0403b41d6b4c Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-933560305 Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotTestJSON-933560305-project Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 9273538810d24fe19acf7c8e190e6dfe Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotTestJSON-933560305-project Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance e22808e9-0efe-4047-bede-233081ef44e2 could not be found. Jul 01 19:51:41.352104 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e22808e9-0efe-4047-bede-233081ef44e2'} Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22808e9-0efe-4047-bede-233081ef44e2 could not be found. Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:51:41.353282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22808e9-0efe-4047-bede-233081ef44e2 could not be found. Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22808e9-0efe-4047-bede-233081ef44e2 could not be found. Jul 01 19:51:41.354974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:51:41.356424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Returning 404 to user: Instance e22808e9-0efe-4047-bede-233081ef44e2 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:51:41.356424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b86ca4c9-0997-47dd-bc38-ea802a9fc48d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2" status: 404 len: 111 microversion: 2.1 time: 0.029936 Jul 01 19:51:41.356424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 569/1125] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:51:41 2022] GET /compute/v2.1/servers/e22808e9-0efe-4047-bede-233081ef44e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:52:00.592322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:00.593169 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:00.597555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-806922772", "imageRef": "cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa", "flavorRef": "452", "networks": [{"uuid": "542dcdb0-c7a6-4b66-9867-c067f0604915"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:00.651541 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] validate_networks() for [('542dcdb0-c7a6-4b66-9867-c067f0604915', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:52:01.436937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:52:01.437709 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:52:01.438205 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:52:01.438936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:52:01.439516 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:52:01.449991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:01.450456 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:01.451531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:01.452270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:01.471251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Getting quotas for project d13ae3749c0f4f9e80ae0403b41d6b4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:52:01.475257 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Getting quotas for user 9273538810d24fe19acf7c8e190e6dfe and project d13ae3749c0f4f9e80ae0403b41d6b4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:52:01.486063 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:52:01.488451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cefd9148-b0cf-4e1c-9496-3c2e7e0ed6fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:52:01.538080 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-65a2ce7c-a118-4592-aa06-3694461fad4a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947541 Jul 01 19:52:01.543942 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 557/1126] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:52:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:52:01.548736 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1914b2a7-b110-465c-a1b9-4f5d6105584e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:01.549327 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1914b2a7-b110-465c-a1b9-4f5d6105584e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:01.553131 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=8 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:01.553593 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:01.634401 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1914b2a7-b110-465c-a1b9-4f5d6105584e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:01.642751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1914b2a7-b110-465c-a1b9-4f5d6105584e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1218 microversion: 2.1 time: 0.097775 Jul 01 19:52:01.643515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 570/1127] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:01 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:02.661070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:02.661639 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:02.671824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:02.672278 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:02.673053 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:02.673490 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:02.737165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:02.744868 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2dcf1581-c3d8-4d08-898c-6155cb7332e7 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1270 microversion: 2.1 time: 0.088409 Jul 01 19:52:02.745480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 558/1128] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:02 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:03.762761 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:03.763325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:03.771238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:03.771724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:03.772501 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:03.772933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:03.904374 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:03.913602 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-edea8de7-3ad7-4fcf-a408-458fc5515e62 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.154986 Jul 01 19:52:03.914235 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 571/1129] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:03 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:04.275515 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-dea0697c-1ea7-4d36-a541-fbbb548abe0a req-0093524c-52e9-4d11-91e8-5cbb6a2eac3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b660141-fe27-4fc9-ab99-1a36618b3cf5", "tag": "cf8afc73-460e-4573-90b9-147b15254c4d"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:04.285736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-dea0697c-1ea7-4d36-a541-fbbb548abe0a req-0093524c-52e9-4d11-91e8-5cbb6a2eac3e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:04.286396 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-dea0697c-1ea7-4d36-a541-fbbb548abe0a req-0093524c-52e9-4d11-91e8-5cbb6a2eac3e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:04.299477 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-dea0697c-1ea7-4d36-a541-fbbb548abe0a req-0093524c-52e9-4d11-91e8-5cbb6a2eac3e service nova] Creating event network-changed:cf8afc73-460e-4573-90b9-147b15254c4d for instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 on hv-cinder-83124 Jul 01 19:52:04.307034 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-dea0697c-1ea7-4d36-a541-fbbb548abe0a req-0093524c-52e9-4d11-91e8-5cbb6a2eac3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034949 Jul 01 19:52:04.307620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 559/1130] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:52:04.932798 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:04.933465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:04.940252 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:04.941048 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:04.941813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:04.942476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:05.082228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:05.089708 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6a755ca5-1c2b-44ff-b6fd-cab454e4ef18 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.160898 Jul 01 19:52:05.090313 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 572/1131] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:04 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:06.108042 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:06.108736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:06.115075 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:06.115536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:06.116288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:06.116717 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:06.254707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:06.268887 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5ab361bc-3695-46a9-9ffd-203e233db01d tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.165539 Jul 01 19:52:06.269593 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 560/1132] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:06 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:07.285562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:07.286261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:07.295842 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:07.296295 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:07.297082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:07.297515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:07.436002 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:07.445271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-82658312-ffc4-4a27-a1f2-3cb59f26b142 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.163394 Jul 01 19:52:07.455578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 573/1133] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:07 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:08.462957 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:08.463529 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:08.470737 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:08.471199 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:08.471976 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:08.472414 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:08.615007 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:08.623168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-55f757d2-b0a9-43c7-bd22-832ef4fd0292 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.164132 Jul 01 19:52:08.623753 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 561/1134] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:08 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:09.640305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:09.640931 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:09.647763 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:09.648476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:09.649464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:09.650035 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:09.918059 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:09.925925 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b6e9a04d-fea4-4ab1-83ad-6ea169c71f13 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.289550 Jul 01 19:52:09.926568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 574/1135] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:09 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:10.944768 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:10.947151 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:10.954970 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:10.955637 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:10.956878 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:10.957469 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:11.167905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:11.185806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e1bfb8b5-1786-443a-b8dc-a7f59709b2d8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.246044 Jul 01 19:52:11.186708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 562/1136] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:10 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:12.202867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:12.204159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:12.206799 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:12.212941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:12.213403 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:12.214216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:12.214720 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:12.361165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:12.368851 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-78a39a14-594e-4ba9-989f-7d707865bb06 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.169980 Jul 01 19:52:12.369640 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 575/1137] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:12 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:12.608772 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:12.611056 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:12.847058 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-678d5e9f-3fbd-400b-9eb3-56bed3c4ec53 req-56f1fa11-48a0-4a8c-a0a4-3567669d0f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b660141-fe27-4fc9-ab99-1a36618b3cf5", "name": "network-vif-plugged", "status": "completed", "tag": "cf8afc73-460e-4573-90b9-147b15254c4d"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:12.855130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-678d5e9f-3fbd-400b-9eb3-56bed3c4ec53 req-56f1fa11-48a0-4a8c-a0a4-3567669d0f4e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:12.855617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-678d5e9f-3fbd-400b-9eb3-56bed3c4ec53 req-56f1fa11-48a0-4a8c-a0a4-3567669d0f4e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:12.867936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-678d5e9f-3fbd-400b-9eb3-56bed3c4ec53 req-56f1fa11-48a0-4a8c-a0a4-3567669d0f4e service nova] Creating event network-vif-plugged:cf8afc73-460e-4573-90b9-147b15254c4d for instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 on hv-cinder-83124 Jul 01 19:52:12.873197 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-678d5e9f-3fbd-400b-9eb3-56bed3c4ec53 req-56f1fa11-48a0-4a8c-a0a4-3567669d0f4e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272027 Jul 01 19:52:12.873825 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 563/1138] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:52:13.387129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:13.387954 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:13.394417 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:13.394858 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:13.400347 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:13.400795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:13.665376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:13.673879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9e9e4366-c82b-44d6-a27d-417e9b12b9c8 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.291612 Jul 01 19:52:13.674659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 576/1139] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:13 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:14.692848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:14.693575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:14.700046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:14.700505 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:14.701301 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:14.701701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:14.854185 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:14.868046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0929c42c-6191-4e3e-a8b1-7b9bc84cbfa5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1318 microversion: 2.1 time: 0.180212 Jul 01 19:52:14.869133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 564/1140] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:14 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:15.885270 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:15.891707 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:15.901015 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:15.901973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:15.902917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:15.905774 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:16.251627 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:16.261095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9a67ad00-a298-4cc9-b437-1409b895ae59 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1507 microversion: 2.1 time: 0.379540 Jul 01 19:52:16.273870 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 577/1141] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:15 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:16.279379 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d2e7bed-64ec-4665-bdde-3da621a6404d", "device": "/dev/sdb"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:16.280711 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:16.287870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:16.288374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:16.289106 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:16.289539 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:16.966862 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0a73a31a-19fd-44a6-89ba-ba2f3d40653e tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "POST /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690696 Jul 01 19:52:16.982546 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 565/1142] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:52:16 2022] POST /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:52:27.452720 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b857446e-6e02-48cf-b01f-748f60ac8b39 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Action: 'create', calling method: .version_select at 0x7f476493a430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-740478170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnogZ3tpTot1pA+P0/ChMw2iMvcF2EC02OBOROK9twIgNUR/XI1bEoOAdlClYYfMHicDfOyNcpp+gJ6KAl66NE8V4Hs8+gePgnt3dbzSTK7EFaAhlTrydU/WxvqcY9zGg=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:27.458714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=18 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:27.459370 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=42 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:27.472822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-b857446e-6e02-48cf-b01f-748f60ac8b39 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Getting quotas for project b0cea6fd9c8b465a862b8cf334a4335c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:52:27.476685 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-b857446e-6e02-48cf-b01f-748f60ac8b39 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Getting quotas for user 5524d84deeb747038a220e64b3c9bf34 and project b0cea6fd9c8b465a862b8cf334a4335c. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:52:27.503209 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b857446e-6e02-48cf-b01f-748f60ac8b39 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054429 Jul 01 19:52:27.503829 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 578/1143] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:52:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:52:27.555070 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:27.555895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:27.560064 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1225521268", "imageRef": "7841f172-76a5-41db-9933-4287e2207f49", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-740478170", "networks": [{"uuid": "0862d062-61dc-4f73-bbfe-8f98e9b983f8"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:27.611235 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] validate_networks() for [('0862d062-61dc-4f73-bbfe-8f98e9b983f8', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:52:27.985497 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:52:27.986040 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:52:27.986491 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:52:27.987012 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:52:27.987789 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:52:27.999029 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:27.999486 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:28.000289 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:28.000729 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:28.019936 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Getting quotas for project b0cea6fd9c8b465a862b8cf334a4335c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:52:28.024987 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Getting quotas for user 5524d84deeb747038a220e64b3c9bf34 and project b0cea6fd9c8b465a862b8cf334a4335c. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:52:28.036842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:52:28.039230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7841f172-76a5-41db-9933-4287e2207f49',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:52:28.095842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d20da7da-080a-431c-8614-ddd26999146a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542252 Jul 01 19:52:28.096501 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 566/1144] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:52:28.106551 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4b4d30da-f140-4585-8fa5-90a67bfa5242 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:28.107254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4b4d30da-f140-4585-8fa5-90a67bfa5242 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:28.162016 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4b4d30da-f140-4585-8fa5-90a67bfa5242 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:28.169664 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4b4d30da-f140-4585-8fa5-90a67bfa5242 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1258 microversion: 2.1 time: 0.067083 Jul 01 19:52:28.170339 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 579/1145] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:28 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:52:29.192351 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:29.193290 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:29.202208 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:29.202662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:29.203422 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:29.203859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:29.274824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:29.282475 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18cf1950-a577-4944-bcd6-24e7d32d301e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1262 microversion: 2.1 time: 0.097852 Jul 01 19:52:29.283082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 567/1146] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:29 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:30.300971 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:30.301569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:30.309556 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:30.310033 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:30.310807 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:30.311240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:30.381201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:30.392552 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b2e7cb1d-24cb-4749-8434-ef38c809670d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1262 microversion: 2.1 time: 0.096788 Jul 01 19:52:30.393280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 580/1147] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:30 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:31.410081 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:31.410813 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:31.417525 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:31.418101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:31.418865 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:31.419295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:31.491924 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:31.500010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be99d2fa-d2c8-495b-b596-091d467160e6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1262 microversion: 2.1 time: 0.093926 Jul 01 19:52:31.500590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 568/1148] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:31 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:32.518026 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:32.519191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:32.528587 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:32.529575 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:32.530404 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:32.531021 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:32.610357 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:32.624858 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ac64ae98-6aae-4dbf-8a78-b3de8909e850 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1316 microversion: 2.1 time: 0.111536 Jul 01 19:52:32.628063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 581/1149] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:32 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1316 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:33.643047 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:33.644432 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:33.651749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:33.652691 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:33.653933 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:33.655402 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:33.793651 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:33.801383 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-60aef3bf-4660-41b0-ad29-09ecd59aa8f2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.162241 Jul 01 19:52:33.801939 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 569/1150] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:33 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:52:34.821355 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:34.822213 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:34.830234 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:34.830973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:34.832242 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:34.832873 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:34.980398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:34.998767 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b3c113b2-03bc-49e7-b3e4-b24ba8167d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.180980 Jul 01 19:52:35.009221 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 582/1151] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:34 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:36.017086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:36.018051 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:36.026818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:36.027261 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:36.028027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:36.028478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:36.167254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:36.175549 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-72480e8a-c5b6-454a-92cf-8d9c312eb0e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.162400 Jul 01 19:52:36.176126 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 570/1152] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:36 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:37.197405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:37.198515 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:37.210040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:37.210791 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:37.212036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:37.212757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:37.348867 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:37.363310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3143a1e9-fa79-4cc6-ad87-64e5eaea332a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.172173 Jul 01 19:52:37.364092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 583/1153] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:37 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:38.381806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:38.382590 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:38.385243 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:38.386137 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:38.392911 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:38.393380 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:38.394168 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:38.394604 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:38.550483 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:38.558189 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3abc9729-a558-45dc-be8f-06d6efc58b40 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.180956 Jul 01 19:52:38.558761 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 571/1154] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:38 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:39.575884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:39.576405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:39.578418 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:39.584641 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:39.585089 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:39.585855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:39.586391 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:39.721499 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:39.729504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b6c052d1-9f93-4c93-a996-fb5efd9e6378 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.157671 Jul 01 19:52:39.730158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 584/1155] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:39 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:40.750259 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:40.750864 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:40.762567 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:40.763743 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:40.764918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:40.765893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:40.900757 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:40.908840 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9209f684-c5ed-4862-99f4-e817c5d6828a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.164142 Jul 01 19:52:40.909411 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 572/1156] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:40 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:41.929019 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:41.929751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:41.939938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:41.940457 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:41.941567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:41.942167 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:42.098062 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:42.105895 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-154a64e3-da2f-48e3-a312-1ae52a1d7708 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.182851 Jul 01 19:52:42.106461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 585/1157] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:41 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:43.124755 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:43.125404 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:43.134103 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:43.134558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:43.135340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:43.135851 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:43.279818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:43.287466 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-76340357-8b69-4766-8aa3-77b1b7ea5753 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.167691 Jul 01 19:52:43.288027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 573/1158] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:43 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:44.306194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:44.307983 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:44.318063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:44.318942 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:44.320182 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:44.320696 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:44.462418 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:44.470874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bc9f5b7a-9b21-4667-8881-68ee26004f6f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.169670 Jul 01 19:52:44.471682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 586/1159] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:44 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:45.487882 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:45.488490 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:45.496714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:45.496714 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:45.497065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:45.498135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:45.631629 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:45.639573 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb05769b-7ccf-434e-8765-a455d5613d9c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.155567 Jul 01 19:52:45.649149 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 574/1160] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:45 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:46.661389 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:46.662528 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:46.675818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:46.676675 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:46.678099 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:46.679120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:46.820259 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:46.828599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d043ec9e-ef7e-41f9-8796-c4ecb9fd4ef9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.174337 Jul 01 19:52:46.829163 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 587/1161] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:46 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:47.114527 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:47.115089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:47.121793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:47.122274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:47.123026 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:47.123453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:47.206820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lazy-loading 'services' on Instance uuid 1b660141-fe27-4fc9-ab99-1a36618b3cf5 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:52:47.283528 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-27075436-3ff6-48fc-8b3b-7180623ba95b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5/os-volume_attachments/0d2e7bed-64ec-4665-bdde-3da621a6404d" status: 202 len: 0 microversion: 2.1 time: 0.172851 Jul 01 19:52:47.284108 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 575/1162] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:52:47 2022] DELETE /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5/os-volume_attachments/0d2e7bed-64ec-4665-bdde-3da621a6404d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:52:47.849461 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:47.850472 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:47.860317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:47.860763 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:47.861523 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:47.861968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:48.001804 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:48.009726 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1896745f-8d3f-40b3-a37a-615a95b6deeb tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.166727 Jul 01 19:52:48.010327 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 588/1163] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:47 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:49.032798 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:49.033374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:49.040722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:49.041170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:49.041934 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:49.042401 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:49.185622 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:49.193904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f03bbd14-f837-4a6f-8405-668bee6123e0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.165558 Jul 01 19:52:49.194555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 576/1164] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:49 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:49.351091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9f81ddad-3c41-4f5f-bc38-d6e9c798b7a7 req-84a4cd30-33e0-4e73-9ec3-cb475cbaa0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:49.360083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9f81ddad-3c41-4f5f-bc38-d6e9c798b7a7 req-84a4cd30-33e0-4e73-9ec3-cb475cbaa0e9 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:49.360522 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9f81ddad-3c41-4f5f-bc38-d6e9c798b7a7 req-84a4cd30-33e0-4e73-9ec3-cb475cbaa0e9 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:49.383599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9f81ddad-3c41-4f5f-bc38-d6e9c798b7a7 req-84a4cd30-33e0-4e73-9ec3-cb475cbaa0e9 service nova] Creating event network-changed:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:52:49.391109 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9f81ddad-3c41-4f5f-bc38-d6e9c798b7a7 req-84a4cd30-33e0-4e73-9ec3-cb475cbaa0e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Jul 01 19:52:49.392024 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 589/1165] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:52:50.215041 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:50.216082 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:50.227219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:50.227968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:50.229234 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:50.229992 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:50.362464 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:50.369997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-536ad9c9-b33e-40d0-a007-8223b7eec8f6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.161500 Jul 01 19:52:50.370571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 577/1166] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:50 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:50.570570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:50.571261 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:50.578561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:50.579008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:50.579771 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:50.580207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:50.607127 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:52:50.690338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7515b741-eed2-4043-ab84-61e36c60eff9 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 204 len: 0 microversion: 2.1 time: 0.123462 Jul 01 19:52:50.691217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 590/1167] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:52:50 2022] DELETE /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:52:50.703133 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:50.704035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:50.713119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:50.713756 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:50.715006 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:50.715479 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:50.853248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:50.861031 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cb53de38-1a33-4f98-b771-4ec44bbca96b tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1513 microversion: 2.1 time: 0.164478 Jul 01 19:52:50.861608 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 578/1168] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:50 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:52:51.392175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:51.393289 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:51.402992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:51.403645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:51.404970 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:51.405405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:51.556312 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:51.564246 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0d239e2c-7b14-4d27-97eb-5d4923a4e03e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.179111 Jul 01 19:52:51.565176 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 591/1169] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:51 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:51.884376 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:51.885010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:51.893326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:51.893779 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:51.894593 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:51.895030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:52.033306 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:52.044309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-443af802-fe89-4512-8597-97432a2b8ead tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1513 microversion: 2.1 time: 0.163875 Jul 01 19:52:52.044852 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 579/1170] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:51 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:52.584443 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:52.585423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:52.596424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:52.597169 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:52.598466 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:52.599201 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:52.743768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:52.751649 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4154a782-e3e7-491f-8d13-5f1ccac1bec8 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.173766 Jul 01 19:52:52.752190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 592/1171] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:52 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:53.061991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:53.062392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:53.069730 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:53.070216 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:53.070996 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:53.071431 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:53.221007 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:53.228823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-97171f82-0784-49b5-9a4a-18929df42c7a tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1513 microversion: 2.1 time: 0.171154 Jul 01 19:52:53.229398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 580/1172] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:53 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:53.773031 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:53.774129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:53.785477 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:53.786283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:53.787543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:53.788247 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:53.931579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:53.943156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c81d3701-3629-4426-8dec-cc63c6a47f90 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.176605 Jul 01 19:52:53.943891 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 593/1173] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:53 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:54.246695 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:54.247311 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:54.256215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:54.256818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:54.257595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:54.258199 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:54.400595 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:54.408382 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4a42d4f3-b7e8-4987-a02e-ea1d641b7562 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1513 microversion: 2.1 time: 0.165664 Jul 01 19:52:54.408963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 581/1174] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:54 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:54.963654 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:54.965059 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:54.975488 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:54.976301 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:54.977319 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:54.977994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:55.175142 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-e1e58af8-b6c2-48ae-b9e8-2ecfa4a2fab3 req-3f303922-2ea0-47e0-a995-f0ca2af2c27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b660141-fe27-4fc9-ab99-1a36618b3cf5", "name": "network-vif-deleted", "tag": "cf8afc73-460e-4573-90b9-147b15254c4d"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:55.183797 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e1e58af8-b6c2-48ae-b9e8-2ecfa4a2fab3 req-3f303922-2ea0-47e0-a995-f0ca2af2c27d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:55.184369 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e1e58af8-b6c2-48ae-b9e8-2ecfa4a2fab3 req-3f303922-2ea0-47e0-a995-f0ca2af2c27d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:55.196588 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-e1e58af8-b6c2-48ae-b9e8-2ecfa4a2fab3 req-3f303922-2ea0-47e0-a995-f0ca2af2c27d service nova] Creating event network-vif-deleted:cf8afc73-460e-4573-90b9-147b15254c4d for instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 on hv-cinder-83124 Jul 01 19:52:55.200914 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:55.208912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-888954c5-5774-4ce7-9fa8-d0e7f3f2348c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.249562 Jul 01 19:52:55.209251 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-e1e58af8-b6c2-48ae-b9e8-2ecfa4a2fab3 req-3f303922-2ea0-47e0-a995-f0ca2af2c27d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038036 Jul 01 19:52:55.210112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 594/1175] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:54 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:55.217535 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 582/1176] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:52:55.425349 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:55.426130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:55.432712 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:55.433162 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:55.433920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:55.434390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:55.455857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:55.468702 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:55.469145 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:55.469585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lazy-loading 'fault' on Instance uuid 1b660141-fe27-4fc9-ab99-1a36618b3cf5 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:52:55.512668 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9273538810d24fe19acf7c8e190e6dfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:55.521283 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-58866bf3-cd29-45aa-a3c6-f4eafcfc9ee5 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 200 len: 1308 microversion: 2.1 time: 0.099966 Jul 01 19:52:55.521849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 595/1177] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:55 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:56.232635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:56.234287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:56.241119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:56.241569 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:56.242392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:56.242845 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:56.247212 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:56.382808 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:56.390971 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e748a791-9e66-4127-8dc7-10358f28593c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.167044 Jul 01 19:52:56.391641 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 583/1178] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:56 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:56.405698 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d95cce62-62ac-4a22-b488-31847439a584 req-2236f33b-21e9-4bf0-83b3-8e3651e1ed06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "name": "network-vif-plugged", "status": "completed", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:56.414671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d95cce62-62ac-4a22-b488-31847439a584 req-2236f33b-21e9-4bf0-83b3-8e3651e1ed06 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:56.415040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d95cce62-62ac-4a22-b488-31847439a584 req-2236f33b-21e9-4bf0-83b3-8e3651e1ed06 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:56.426884 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d95cce62-62ac-4a22-b488-31847439a584 req-2236f33b-21e9-4bf0-83b3-8e3651e1ed06 service nova] Creating event network-vif-plugged:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:52:56.431949 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d95cce62-62ac-4a22-b488-31847439a584 req-2236f33b-21e9-4bf0-83b3-8e3651e1ed06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Jul 01 19:52:56.432572 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 596/1179] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:52:56.544002 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:56.544615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] [instance: 1b660141-fe27-4fc9-ab99-1a36618b3cf5] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:56.550707 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:56.551160 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:56.551932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:56.552367 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:56.569841 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] HTTP exception thrown: Instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 could not be found. Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Request method failure captured: Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 HTTP/1.1 Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv0_rVhKHLRFbh9pkmxE2WJKhB4h9ZvZ3jIFsJaN30eY01YNcelihTVjp5qSE44JCWsRcD80pGjuyD-SJ4VLlRAjTVoCV0tog4DsoBgRDNTmjXSVHT5ITEXoIhL715_0tOnisvtptq1FdgrDWL50A9ttYrDyXC_2syTJQkN7TxR6k7pc Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: d13ae3749c0f4f9e80ae0403b41d6b4c Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotTestJSON-933560305 Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 19:52:56.571776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d13ae3749c0f4f9e80ae0403b41d6b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d13ae3749c0f4f9e80ae0403b41d6b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d13ae3749c0f4f9e80ae0403b41d6b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d13ae3749c0f4f9e80ae0403b41d6b4c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotTestJSON-933560305 Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: d13ae3749c0f4f9e80ae0403b41d6b4c Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-933560305 Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotTestJSON-933560305-project Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 9273538810d24fe19acf7c8e190e6dfe Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotTestJSON-933560305-project Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 could not be found. Jul 01 19:52:56.573465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '1b660141-fe27-4fc9-ab99-1a36618b3cf5'} Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 could not be found. Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:56.574806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 could not be found. Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 could not be found. Jul 01 19:52:56.576373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 19:52:56.577674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] Returning 404 to user: Instance 1b660141-fe27-4fc9-ab99-1a36618b3cf5 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:56.577674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-89e290a5-de7f-4735-aca8-70dd73f89223 tempest-VolumesSnapshotTestJSON-933560305 tempest-VolumesSnapshotTestJSON-933560305-project] 10.222.0.61 "GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5" status: 404 len: 111 microversion: 2.1 time: 0.033190 Jul 01 19:52:56.577674 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 584/1180] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:56 2022] GET /compute/v2.1/servers/1b660141-fe27-4fc9-ab99-1a36618b3cf5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:52:57.408424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:57.409132 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:57.416338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:57.416783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:57.417574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:57.418037 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:57.555831 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:57.567829 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e517556d-35a2-4128-84c0-6846b62ac91f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1358 microversion: 2.1 time: 0.163502 Jul 01 19:52:57.568646 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 597/1181] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:57 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:58.586276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:58.586916 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:58.589580 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:58.596078 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:58.596659 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:58.597526 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:58.598092 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:58.747225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:58.754963 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-94b1a36b-21e9-4466-a26e-e2b0594bdfa1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1548 microversion: 2.1 time: 0.173474 Jul 01 19:52:58.755517 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 585/1182] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:58 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:58.774372 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:58.775003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:58.778599 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:58.786992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:58.787594 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:58.788659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:58.789251 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:58.924942 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:58.936511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ebcbe3cb-2f28-4cf1-97d2-142b21b21d52 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1548 microversion: 2.1 time: 0.168224 Jul 01 19:52:58.937358 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 598/1183] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:58 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:52:58.958125 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:58.961657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:58.962472 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Searching by: {'deleted': False, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c'} {{(pid=124349) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 19:52:58.969565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:58.970008 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:58.970814 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:58.971240 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:59.062260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.multi_cell_list [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124349) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 19:52:59.158637 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cb1c4d86-3226-4925-8899-faad8483a960 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204409 Jul 01 19:52:59.159216 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 586/1184] 10.222.0.61 () {58 vars in 1124 bytes} [Fri Jul 1 19:52:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:52:59.175159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:59.176025 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:59.185682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:59.186423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:59.187190 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:59.187622 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:59.322572 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:59.334504 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-df4888f6-03d1-41e0-8df9-06b52388a9f9 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1548 microversion: 2.1 time: 0.165334 Jul 01 19:52:59.335091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 599/1185] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:59 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:02.996776 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6045caf-eacc-4ffc-b11c-fa83a0e1798f"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:02.997886 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:03.005243 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:03.005646 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:03.006492 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:03.006926 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:03.272000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-48d8f786-24fa-4605-ab90-9d342c16665a tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279216 Jul 01 19:53:03.272630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 587/1186] 10.222.0.61 () {60 vars in 1322 bytes} [Fri Jul 1 19:53:02 2022] POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:12.996447 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:12.997095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:12.999290 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:12.999928 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=24 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:13.006236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:13.006623 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:13.007383 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:13.007826 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:13.148325 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:13.156795 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7ef7105c-f667-4712-8539-845669a2aa79 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1594 microversion: 2.1 time: 0.164846 Jul 01 19:53:13.157365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 600/1187] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:12 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:15.180222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:15.181059 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=5 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:15.181734 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:15.185905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-439dfcc9-59d9-405d-b7ad-9b67e79e2811 req-5dc3ee66-09b5-4e89-bb3e-ce39bd7b8841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:15.202046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-439dfcc9-59d9-405d-b7ad-9b67e79e2811 req-5dc3ee66-09b5-4e89-bb3e-ce39bd7b8841 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:15.202760 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-439dfcc9-59d9-405d-b7ad-9b67e79e2811 req-5dc3ee66-09b5-4e89-bb3e-ce39bd7b8841 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:15.217131 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-439dfcc9-59d9-405d-b7ad-9b67e79e2811 req-5dc3ee66-09b5-4e89-bb3e-ce39bd7b8841 service nova] Creating event network-changed:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:53:15.222951 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-439dfcc9-59d9-405d-b7ad-9b67e79e2811 req-5dc3ee66-09b5-4e89-bb3e-ce39bd7b8841 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044132 Jul 01 19:53:15.223985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 588/1188] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:16.309816 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1741464755"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:16.310365 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:16.317845 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:16.318309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:16.319621 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:16.320064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:16.460890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.network.security_group_api [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Adding security group 610d13c6-f19f-457a-b486-78dd929e3a97 to port bd512c8f-fdce-44b6-9f42-6dc74321d76f Jul 01 19:53:16.843082 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-34570781-c302-41ad-85ee-7c305f87af42 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/action" status: 202 len: 0 microversion: 2.1 time: 0.537206 Jul 01 19:53:16.844991 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 601/1189] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:53:16 2022] POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:53:16.854759 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:16.855450 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:16.863551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:16.864465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:16.865465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:16.866141 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.035127 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:17.043329 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7de77d07-726e-4873-a516-bb56b8ca26e5 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1760 microversion: 2.1 time: 0.193658 Jul 01 19:53:17.044015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 589/1190] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:16 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:17.238502 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9974e11f-1832-48ea-81c7-1d3b60005511 req-df360251-7e30-4da3-8811-4173907e43ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:17.248375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9974e11f-1832-48ea-81c7-1d3b60005511 req-df360251-7e30-4da3-8811-4173907e43ff service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:17.248912 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9974e11f-1832-48ea-81c7-1d3b60005511 req-df360251-7e30-4da3-8811-4173907e43ff service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.261177 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9974e11f-1832-48ea-81c7-1d3b60005511 req-df360251-7e30-4da3-8811-4173907e43ff service nova] Creating event network-changed:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:53:17.266546 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9974e11f-1832-48ea-81c7-1d3b60005511 req-df360251-7e30-4da3-8811-4173907e43ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031938 Jul 01 19:53:17.267116 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 602/1191] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:32.992001 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:32.992926 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=8 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:33.185480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-13fde738-3f43-4c9f-8942-448d13f9a0e2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Action: 'create', calling method: .version_select at 0x7f476491caf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1459100450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpF5zCF+ZI+ISnnqBnqHiKpXjjHAdvT6VQ+ccZcqUzc9K4fvNPUtG64QXjmgEsVCzw98ZceU475C5EBT19l5Pg5Jp0JN/V5mq0RTy6l8qg5pD4OQPLHlXFfx65oYS0fFA=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:33.205389 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-13fde738-3f43-4c9f-8942-448d13f9a0e2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:33.210271 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-13fde738-3f43-4c9f-8942-448d13f9a0e2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for user 5a38bc1705a64785aaac2b561159fa26 and project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:33.242333 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-13fde738-3f43-4c9f-8942-448d13f9a0e2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.255395 Jul 01 19:53:33.243284 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 590/1192] 10.222.0.61 () {60 vars in 1158 bytes} [Fri Jul 1 19:53:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:58.084664 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:58.085407 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=12 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:58.089742 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1834883740", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1459100450", "security_groups": [{"name": "tempest-secgroup-smoke-1233299789"}], "block_device_mapping_v2": [{"uuid": "ea615de0-eb50-4aaa-9d5b-048eecc3ec70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda1c18a-7073-4265-8264-0ef156ace9a6"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:58.330737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] validate_networks() for [('fda1c18a-7073-4265-8264-0ef156ace9a6', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:53:59.054362 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:53:59.054781 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:53:59.055245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:53:59.055645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:53:59.056052 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:53:59.067130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:59.067677 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:59.068516 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:59.068958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:59.086562 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:59.091014 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for user 5a38bc1705a64785aaac2b561159fa26 and project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:59.156838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:53:59.159092 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea615de0-eb50-4aaa-9d5b-048eecc3ec70',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:53:59.321033 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-28e6b978-b1f4-4cc1-9aa8-772f0d7e05c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237924 Jul 01 19:53:59.321688 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 603/1193] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:53:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:53:59.334117 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:59.335854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:59.342989 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c992dc38-b20c-4e74-9809-fef86b1ccfa6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:59.344035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c992dc38-b20c-4e74-9809-fef86b1ccfa6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:59.454732 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c992dc38-b20c-4e74-9809-fef86b1ccfa6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:59.461763 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c992dc38-b20c-4e74-9809-fef86b1ccfa6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1095 microversion: 2.1 time: 0.130448 Jul 01 19:53:59.462347 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 591/1194] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:59 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1095 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:00.479119 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:00.479856 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:00.486724 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:00.487195 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:00.487960 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:00.488398 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:00.561728 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:00.570266 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-77857ffe-47e0-42fd-9205-ed5beb1204ee tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1211 microversion: 2.1 time: 0.095617 Jul 01 19:54:00.579754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 604/1195] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:00 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:01.587536 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:01.588139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:01.595451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.595893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.596657 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.597085 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.815340 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:01.823065 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f73ffe65-e7b2-415d-a740-c0479b05bae8 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.239439 Jul 01 19:54:01.823666 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 592/1196] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:01 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:01.928464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8719d54d-6e34-4ea2-a885-e83e1dee0be9 req-7c12d038-4a7f-4af5-9048-14a868bc02f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde3a7b0-5fc1-4054-bd2c-0d24b239586b", "tag": "535b56c3-466a-4616-9e80-453be22de738"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:01.938475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8719d54d-6e34-4ea2-a885-e83e1dee0be9 req-7c12d038-4a7f-4af5-9048-14a868bc02f2 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.939207 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8719d54d-6e34-4ea2-a885-e83e1dee0be9 req-7c12d038-4a7f-4af5-9048-14a868bc02f2 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.953380 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8719d54d-6e34-4ea2-a885-e83e1dee0be9 req-7c12d038-4a7f-4af5-9048-14a868bc02f2 service nova] Creating event network-changed:535b56c3-466a-4616-9e80-453be22de738 for instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b on hv-cinder-83124 Jul 01 19:54:01.958465 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8719d54d-6e34-4ea2-a885-e83e1dee0be9 req-7c12d038-4a7f-4af5-9048-14a868bc02f2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Jul 01 19:54:01.959064 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 605/1197] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:02.842299 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:02.843071 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:02.851731 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:02.852184 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:02.852955 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:02.853390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:02.988335 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:02.996044 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-73df28dd-4284-4824-a917-5d5708969a12 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.159034 Jul 01 19:54:02.996644 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 593/1198] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:02 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:04.014376 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:04.015067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:04.021458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:04.021903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:04.022689 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:04.023120 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:04.164326 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:04.173148 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-56bd790c-f1a3-440e-9662-f819957529b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.163591 Jul 01 19:54:04.173725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 606/1199] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:04 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:05.199045 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:05.200119 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:05.211260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:05.212043 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:05.213030 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:05.213465 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:05.352844 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:05.364815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8053b0ea-3bb0-4464-b6a2-1e3b4079ed26 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.171976 Jul 01 19:54:05.365749 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 594/1200] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:05 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:06.386571 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:06.387319 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:06.395941 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:06.396542 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:06.397558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:06.398174 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:06.538106 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:06.546486 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4602f65b-4e94-4c6c-9362-a1ccd0085ac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.166508 Jul 01 19:54:06.547047 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 607/1201] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:06 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:07.567403 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:07.568399 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:07.579390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:07.580135 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:07.581393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:07.582157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:07.725913 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:07.734708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d639e0e9-f14d-40fd-917d-367e9e3979e0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.174262 Jul 01 19:54:07.735267 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 595/1202] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:07 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:08.752902 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:08.753574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:08.762124 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.762674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.763597 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.764130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.910378 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:08.922003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8a1b833c-1458-4a35-bed7-b82ef0e9f23c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.173402 Jul 01 19:54:08.922733 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 608/1203] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:08 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:09.945477 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:09.946289 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:09.948683 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:09.954555 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:09.955000 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:09.955766 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:09.956203 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:10.085376 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:10.093293 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0c340c73-37f1-4602-87eb-dfc77b14040b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.153529 Jul 01 19:54:10.093876 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 596/1204] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:09 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:11.118230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:11.119231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:11.121217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:11.121980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:11.129394 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:11.130147 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:11.131105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:11.131543 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:11.273570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:11.281333 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d6a4ed5e-8874-444a-8882-5e2ad2a1faed tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.173458 Jul 01 19:54:11.281898 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 609/1205] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:11 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:12.302443 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:12.303407 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:12.314942 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.315581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:12.316879 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.317620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:12.455617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:12.466792 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5a6fdaaa-4bff-4c7a-8caf-d54f4b32c292 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.170543 Jul 01 19:54:12.467571 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 597/1206] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:12 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:12.736980 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-93680f7c-6aa5-45d0-bdbb-a8a415d17810 req-70d64e25-3b31-4a1a-9a77-246545f041c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde3a7b0-5fc1-4054-bd2c-0d24b239586b", "name": "network-vif-plugged", "status": "completed", "tag": "535b56c3-466a-4616-9e80-453be22de738"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:12.746716 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-93680f7c-6aa5-45d0-bdbb-a8a415d17810 req-70d64e25-3b31-4a1a-9a77-246545f041c3 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.747236 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-93680f7c-6aa5-45d0-bdbb-a8a415d17810 req-70d64e25-3b31-4a1a-9a77-246545f041c3 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:12.760159 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-93680f7c-6aa5-45d0-bdbb-a8a415d17810 req-70d64e25-3b31-4a1a-9a77-246545f041c3 service nova] Creating event network-vif-plugged:535b56c3-466a-4616-9e80-453be22de738 for instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b on hv-cinder-83124 Jul 01 19:54:12.765118 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-93680f7c-6aa5-45d0-bdbb-a8a415d17810 req-70d64e25-3b31-4a1a-9a77-246545f041c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031907 Jul 01 19:54:12.765886 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 610/1207] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:13.492453 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:13.493424 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:13.501122 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:13.501581 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:13.502373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:13.502817 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:13.640576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:13.651905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-365533cc-e3da-4d42-bd8a-72b4f0cec4ad tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1267 microversion: 2.1 time: 0.166133 Jul 01 19:54:13.652473 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 598/1208] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:13 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:14.670041 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:14.670734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:14.677427 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.677871 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.678660 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.679091 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.820111 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:14.828353 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f43100d3-30cf-4508-bd75-2c0af37ed1f9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1454 microversion: 2.1 time: 0.163228 Jul 01 19:54:14.828917 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 611/1209] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:14 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:14.848531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:14.849112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:14.855788 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.856229 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.856980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.857415 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:15.004780 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:15.014163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5bd6ee39-7354-4c5c-9c80-9185c156d3b6 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1454 microversion: 2.1 time: 0.169288 Jul 01 19:54:15.015495 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 599/1210] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:14 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:16.911585 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-30610995-a278-4d31-bfdc-bba86a38f1c5 req-d49ac609-3aa4-43f3-962a-9dbbe9461b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde3a7b0-5fc1-4054-bd2c-0d24b239586b", "tag": "535b56c3-466a-4616-9e80-453be22de738"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:16.920483 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-30610995-a278-4d31-bfdc-bba86a38f1c5 req-d49ac609-3aa4-43f3-962a-9dbbe9461b2d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:16.922105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-30610995-a278-4d31-bfdc-bba86a38f1c5 req-d49ac609-3aa4-43f3-962a-9dbbe9461b2d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:16.935032 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-30610995-a278-4d31-bfdc-bba86a38f1c5 req-d49ac609-3aa4-43f3-962a-9dbbe9461b2d service nova] Creating event network-changed:535b56c3-466a-4616-9e80-453be22de738 for instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b on hv-cinder-83124 Jul 01 19:54:16.940285 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-30610995-a278-4d31-bfdc-bba86a38f1c5 req-d49ac609-3aa4-43f3-962a-9dbbe9461b2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032436 Jul 01 19:54:16.940887 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 612/1211] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:28.130829 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:28.132474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:28.136409 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=20 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:28.137524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=48 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:28.144084 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:28.144524 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:28.145309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:28.145730 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:28.227647 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1a57e4e7-ef78-4de6-b638-de6080cb3567 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/action" status: 202 len: 0 microversion: 2.1 time: 0.103374 Jul 01 19:54:28.228310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 600/1212] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:54:28 2022] POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:54:28.235423 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:28.236243 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=44 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:28.240529 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:28.241217 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:28.248755 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:28.249191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:28.249979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:28.250402 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:28.485050 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:28.493639 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-01c306bf-fc69-4f94-b38a-ac29b49711bc tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1752 microversion: 2.1 time: 0.259698 Jul 01 19:54:28.494254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 613/1213] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:28 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:29.514754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:29.515503 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:29.522697 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:29.523167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:29.523983 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:29.524429 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:29.677691 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:29.685966 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a3301369-c943-4a57-96fe-f98d43bccce2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.177706 Jul 01 19:54:29.686551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 601/1214] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:29 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:30.707945 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:30.708844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:30.718629 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.719083 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.719852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.720288 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.878656 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:30.887302 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e5d72163-da8b-4585-a861-3c761847b86b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.186088 Jul 01 19:54:30.888111 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 614/1215] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:30 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:31.906305 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:31.907050 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:31.915129 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:31.915688 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:31.916630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:31.917172 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.063006 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:32.071225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f1d24db0-1583-4f66-b7f3-e6fb3e89e5c6 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.169938 Jul 01 19:54:32.071795 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 602/1216] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:31 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:33.090863 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:33.091448 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:33.101725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.102494 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.103743 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.104430 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.280962 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:33.293432 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-85732008-da26-47cc-810f-684f88588f1e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.208752 Jul 01 19:54:33.294054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 615/1217] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:33 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:34.316256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:34.317274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:34.327979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.328708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.329984 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.330705 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.478394 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:34.490787 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d439cb45-2841-4410-b132-d571ff4152aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.181293 Jul 01 19:54:34.491435 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 603/1218] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:34 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:35.515297 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:35.515985 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:35.523464 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:35.523991 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.524882 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:35.525390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.682874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:35.691578 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-10232e13-cc5b-475d-b84a-63ddf0c8c24e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.182969 Jul 01 19:54:35.692130 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 616/1219] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:35 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:36.711266 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:36.711908 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:36.719170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.719617 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.720373 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.720823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.927167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:36.936369 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2e5578ac-31ca-46df-8fe7-a171e3cd476c tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.230397 Jul 01 19:54:36.937096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 604/1220] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:36 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:37.958679 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:37.959540 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:37.969630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:37.970164 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:37.970938 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:37.971596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:38.126067 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:38.138852 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6e62ec1d-d19d-4fee-aeaf-7874b0dee5f4 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.186921 Jul 01 19:54:38.139732 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 617/1221] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:37 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:39.160807 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:39.161799 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:39.171940 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.172380 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.173130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.173551 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.315553 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:39.327679 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5f435514-9504-4827-afc2-eca65c7f200e tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1757 microversion: 2.1 time: 0.173555 Jul 01 19:54:39.328254 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 605/1222] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:39 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:40.345324 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:40.346004 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:40.353112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:40.353567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:40.354371 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:40.354805 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:40.498493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:40.506674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-032d3c35-b567-488c-bfac-63ecd3c55f8f tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1760 microversion: 2.1 time: 0.165383 Jul 01 19:54:40.507240 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 618/1223] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:40 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:09.559904 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:55:09.561192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 19:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:55:20.239455 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:55:20.240165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 19:55:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:55:44.085339 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=12 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:44.086124 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:44.090228 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1741464755"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:44.090754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:44.097793 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.098352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.099089 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.099544 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.231822 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.network.security_group_api [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Removing security group 610d13c6-f19f-457a-b486-78dd929e3a97 from port bd512c8f-fdce-44b6-9f42-6dc74321d76f Jul 01 19:55:44.590459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ae7ce878-5edc-4534-880e-6905c646d74b tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/action" status: 202 len: 0 microversion: 2.1 time: 0.506800 Jul 01 19:55:44.596015 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 606/1224] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Jul 1 19:55:44 2022] POST /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:55:44.598446 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=12 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:44.599710 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=36 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:44.689129 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-5ce327a0-1d51-4790-b5a7-1a4edb9b22a7 req-93c3eb42-c831-48ef-bd3c-1550cd6bb9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:44.699110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5ce327a0-1d51-4790-b5a7-1a4edb9b22a7 req-93c3eb42-c831-48ef-bd3c-1550cd6bb9bf service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.699596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5ce327a0-1d51-4790-b5a7-1a4edb9b22a7 req-93c3eb42-c831-48ef-bd3c-1550cd6bb9bf service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.712009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-5ce327a0-1d51-4790-b5a7-1a4edb9b22a7 req-93c3eb42-c831-48ef-bd3c-1550cd6bb9bf service nova] Creating event network-changed:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:55:44.718157 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-5ce327a0-1d51-4790-b5a7-1a4edb9b22a7 req-93c3eb42-c831-48ef-bd3c-1550cd6bb9bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123260 Jul 01 19:55:44.719644 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 619/1225] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:45.656994 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:45.657542 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:45.658181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-6dc17ce5-67ab-42d8-bff1-06d9ce5b8ee7 req-c68b8b26-e6fc-43c4-ac4b-d0010878840e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:45.664057 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.664932 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.665621 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.666326 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.667721 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6dc17ce5-67ab-42d8-bff1-06d9ce5b8ee7 req-c68b8b26-e6fc-43c4-ac4b-d0010878840e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.668165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6dc17ce5-67ab-42d8-bff1-06d9ce5b8ee7 req-c68b8b26-e6fc-43c4-ac4b-d0010878840e service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.679561 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-6dc17ce5-67ab-42d8-bff1-06d9ce5b8ee7 req-c68b8b26-e6fc-43c4-ac4b-d0010878840e service nova] Creating event network-changed:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:55:45.684387 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-6dc17ce5-67ab-42d8-bff1-06d9ce5b8ee7 req-c68b8b26-e6fc-43c4-ac4b-d0010878840e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030251 Jul 01 19:55:45.685519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 620/1226] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:55:45.756649 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lazy-loading 'services' on Instance uuid 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:55:45.839164 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d41ad0ad-cd8a-4685-81a4-45ba9f1a99bf tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments/f6045caf-eacc-4ffc-b11c-fa83a0e1798f" status: 202 len: 0 microversion: 2.1 time: 0.186941 Jul 01 19:55:45.839991 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 607/1227] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:55:45 2022] DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments/f6045caf-eacc-4ffc-b11c-fa83a0e1798f => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:55:45.854400 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:45.855813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:45.862826 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.863686 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.864645 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.865284 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.912230 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-80f72ab7-bdf2-4336-b568-1a5b9523031d tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065032 Jul 01 19:55:45.913063 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 621/1228] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:55:45 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:46.925722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:46.926845 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:46.933575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.934226 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:46.934996 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.935458 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:46.966165 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-91fa30d1-118f-42af-b301-3b318beb1ff2 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045272 Jul 01 19:55:46.966730 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 608/1229] 10.222.0.61 () {58 vars in 1301 bytes} [Fri Jul 1 19:55:46 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:55:46.977009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:46.977518 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:46.984487 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.984933 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:46.985786 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.986255 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:47.072909 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] HTTP exception thrown: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 is not attached to volume f6045caf-eacc-4ffc-b11c-fa83a0e1798f Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Request method failure captured: Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments/f6045caf-eacc-4ffc-b11c-fa83a0e1798f HTTP/1.1 Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv1Bs5-AxzbL8eS0H-6Ng8bxy0spLPRgzEPsIBF6Za4DJLscYHPudVAgr4kQzrND9TmBzbANGHVzGY2C9XWateNhmR-LbTqIcVltxhHGL7FWTy5HNzCxE-p_1xSjFEpSxirSaY1vOiYwjThdj6Nxn1fyqy9Tnd497vOr4nLjL2Jz_6FQ Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: b0cea6fd9c8b465a862b8cf334a4335c Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestMinimumBasicScenario-545229881 Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:55:47.075363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b0cea6fd9c8b465a862b8cf334a4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b0cea6fd9c8b465a862b8cf334a4335c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b0cea6fd9c8b465a862b8cf334a4335c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b0cea6fd9c8b465a862b8cf334a4335c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestMinimumBasicScenario-545229881 Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: b0cea6fd9c8b465a862b8cf334a4335c Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-545229881 Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-TestMinimumBasicScenario-545229881-project Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 5524d84deeb747038a220e64b3c9bf34 Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestMinimumBasicScenario-545229881-project Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:55:47.077238 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 is not attached to volume f6045caf-eacc-4ffc-b11c-fa83a0e1798f Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '307b4b5c-b6d8-46b6-a718-cbf038eb2d07', 'id': 'f6045caf-eacc-4ffc-b11c-fa83a0e1798f'} Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6045caf-eacc-4ffc-b11c-fa83a0e1798f. Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:55:47.078256 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 is not attached to volume f6045caf-eacc-4ffc-b11c-fa83a0e1798f Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 is not attached to volume f6045caf-eacc-4ffc-b11c-fa83a0e1798f Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:47.079981 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Returning 404 to user: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 is not attached to volume f6045caf-eacc-4ffc-b11c-fa83a0e1798f {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:55:47.081340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a7dcadfe-f575-488e-9f06-e7285368af35 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments/f6045caf-eacc-4ffc-b11c-fa83a0e1798f" status: 404 len: 154 microversion: 2.1 time: 0.104081 Jul 01 19:55:47.081340 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 622/1230] 10.222.0.61 () {58 vars in 1415 bytes} [Fri Jul 1 19:55:46 2022] DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07/os-volume_attachments/f6045caf-eacc-4ffc-b11c-fa83a0e1798f => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:55:48.221968 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:48.222482 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:48.229279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.229729 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.230530 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.230964 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.257370 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:55:48.336745 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0179e792-643b-4e20-80b6-5fede84bc8d1 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 204 len: 0 microversion: 2.1 time: 0.118309 Jul 01 19:55:48.337270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 609/1231] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:55:48 2022] DELETE /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:55:48.345890 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:48.346532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:48.353369 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.353815 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.354659 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.355069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.509813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:48.518112 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-78e2cac1-de63-4187-8406-257ed13a14a0 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1554 microversion: 2.1 time: 0.175929 Jul 01 19:55:48.518663 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 623/1232] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:48 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:49.540228 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:49.541416 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:49.549092 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:49.549507 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:49.550345 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:49.550781 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:49.686680 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:49.698675 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-64c7dcab-7f5a-4d27-bbdf-f7766f34f700 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1554 microversion: 2.1 time: 0.165178 Jul 01 19:55:49.699457 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 610/1233] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:49 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:50.721007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:50.722191 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:50.728648 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:50.729098 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:50.729838 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:50.730317 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:50.942270 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5524d84deeb747038a220e64b3c9bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cea6fd9c8b465a862b8cf334a4335c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:50.950509 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2ea2211e-fe9d-49c9-bcf4-0057974813fa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 200 len: 1554 microversion: 2.1 time: 0.233456 Jul 01 19:55:50.951080 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 624/1234] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:50 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:51.188574 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-e9fb29a0-5347-455b-8f80-d7724b3446e0 req-57e72731-1c99-48ed-959d-a0976d61135f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b4b5c-b6d8-46b6-a718-cbf038eb2d07", "name": "network-vif-deleted", "tag": "bd512c8f-fdce-44b6-9f42-6dc74321d76f"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:51.199139 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e9fb29a0-5347-455b-8f80-d7724b3446e0 req-57e72731-1c99-48ed-959d-a0976d61135f service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.199616 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-e9fb29a0-5347-455b-8f80-d7724b3446e0 req-57e72731-1c99-48ed-959d-a0976d61135f service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:51.214203 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-e9fb29a0-5347-455b-8f80-d7724b3446e0 req-57e72731-1c99-48ed-959d-a0976d61135f service nova] Creating event network-vif-deleted:bd512c8f-fdce-44b6-9f42-6dc74321d76f for instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 on hv-cinder-83124 Jul 01 19:55:51.220830 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-e9fb29a0-5347-455b-8f80-d7724b3446e0 req-57e72731-1c99-48ed-959d-a0976d61135f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036085 Jul 01 19:55:51.222090 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 611/1235] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:51.972681 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:51.973754 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] [instance: 307b4b5c-b6d8-46b6-a718-cbf038eb2d07] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:51.984743 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.985495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:51.986827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.987570 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:52.014254 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] HTTP exception thrown: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 could not be found. Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Request method failure captured: Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 HTTP/1.1 Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv1Bs5-AxzbL8eS0H-6Ng8bxy0spLPRgzEPsIBF6Za4DJLscYHPudVAgr4kQzrND9TmBzbANGHVzGY2C9XWateNhmR-LbTqIcVltxhHGL7FWTy5HNzCxE-p_1xSjFEpSxirSaY1vOiYwjThdj6Nxn1fyqy9Tnd497vOr4nLjL2Jz_6FQ Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: b0cea6fd9c8b465a862b8cf334a4335c Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestMinimumBasicScenario-545229881 Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:55:52.015963 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b0cea6fd9c8b465a862b8cf334a4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b0cea6fd9c8b465a862b8cf334a4335c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b0cea6fd9c8b465a862b8cf334a4335c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b0cea6fd9c8b465a862b8cf334a4335c", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestMinimumBasicScenario-545229881 Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: b0cea6fd9c8b465a862b8cf334a4335c Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-545229881 Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-TestMinimumBasicScenario-545229881-project Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 5524d84deeb747038a220e64b3c9bf34 Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestMinimumBasicScenario-545229881-project Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 could not be found. Jul 01 19:55:52.017638 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': '307b4b5c-b6d8-46b6-a718-cbf038eb2d07'} Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 could not be found. Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:55:52.018610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 could not be found. Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 could not be found. Jul 01 19:55:52.019935 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:55:52.021154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Returning 404 to user: Instance 307b4b5c-b6d8-46b6-a718-cbf038eb2d07 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:55:52.021154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6e4af3bc-6a00-4abd-a6dd-705e08b168aa tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07" status: 404 len: 111 microversion: 2.1 time: 0.051513 Jul 01 19:55:52.021154 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 625/1236] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:51 2022] GET /compute/v2.1/servers/307b4b5c-b6d8-46b6-a718-cbf038eb2d07 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:55:52.026765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b86d8476-bd05-4596-8037-57fe1d9bee33 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] Calling method '.version_select at 0x7f4764c65f70>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:52.047136 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b86d8476-bd05-4596-8037-57fe1d9bee33 tempest-TestMinimumBasicScenario-545229881 tempest-TestMinimumBasicScenario-545229881-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-740478170" status: 202 len: 0 microversion: 2.1 time: 0.024523 Jul 01 19:55:52.047905 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 612/1237] 10.222.0.61 () {58 vars in 1268 bytes} [Fri Jul 1 19:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-740478170 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:56:43.809519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:43.810192 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:43.812631 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=14 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:43.813271 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=30 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:43.819618 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.820184 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.820953 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.821386 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.847363 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:56:43.926610 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1dd3b3e5-c63f-4c65-b5eb-986ce750fb88 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 204 len: 0 microversion: 2.1 time: 0.120723 Jul 01 19:56:43.927199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 626/1238] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 19:56:43 2022] DELETE /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:56:43.933740 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:43.934522 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:43.939035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:43.939742 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:43.947339 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.947834 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.948659 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.949096 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:44.083309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:44.091322 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f4914eeb-ad5d-4989-a0fc-7592d50c524e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1579 microversion: 2.1 time: 0.159304 Jul 01 19:56:44.091863 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 613/1239] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:43 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:45.115606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:45.116777 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:45.127870 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:45.128839 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:45.129979 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:45.130431 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:45.271958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:45.279695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9631c486-9ae7-47d2-9381-6a7d51f6af36 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1579 microversion: 2.1 time: 0.171320 Jul 01 19:56:45.280227 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 627/1240] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:45 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:46.296838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:46.297480 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:46.305358 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.305791 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.306589 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.307017 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.394858 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:46.403218 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ba388830-4d25-4099-b1db-2bc1d2c57cf0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1511 microversion: 2.1 time: 0.110324 Jul 01 19:56:46.403764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 614/1241] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:46 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:46.913903 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a9ba8a48-7d76-4afc-b8ae-33158512783d req-efc67e7e-e7f2-455c-bf35-9ba013507dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde3a7b0-5fc1-4054-bd2c-0d24b239586b", "name": "network-vif-deleted", "tag": "535b56c3-466a-4616-9e80-453be22de738"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:46.932546 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a9ba8a48-7d76-4afc-b8ae-33158512783d req-efc67e7e-e7f2-455c-bf35-9ba013507dea service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.933039 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a9ba8a48-7d76-4afc-b8ae-33158512783d req-efc67e7e-e7f2-455c-bf35-9ba013507dea service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.945194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a9ba8a48-7d76-4afc-b8ae-33158512783d req-efc67e7e-e7f2-455c-bf35-9ba013507dea service nova] Creating event network-vif-deleted:535b56c3-466a-4616-9e80-453be22de738 for instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b on hv-cinder-83124 Jul 01 19:56:46.950406 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-a9ba8a48-7d76-4afc-b8ae-33158512783d req-efc67e7e-e7f2-455c-bf35-9ba013507dea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041194 Jul 01 19:56:46.950992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 628/1242] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:47.420914 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:47.421627 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:47.428741 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.429222 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:47.429982 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.430432 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:47.462215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.462575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:47.463023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lazy-loading 'fault' on Instance uuid fde3a7b0-5fc1-4054-bd2c-0d24b239586b {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:56:47.506279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:47.513896 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c5994b0d-0542-40cd-95c2-5b6f356e3d7c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 200 len: 1231 microversion: 2.1 time: 0.097138 Jul 01 19:56:47.514483 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 615/1243] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:47 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:48.536425 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:48.537548 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:48.548419 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.549200 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.550539 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.551299 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.566088 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] HTTP exception thrown: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Request method failure captured: Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b HTTP/1.1 Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv1C4ZviDDEXLQ7S8bqCLD0Q9c19744wzvE3urzHu0e6VvA0D8Kt_Hsp4V4qvLt3UUTcfeXzgz6udSEZZi585SwB8OGicIry9H2xzNUl5UVBVFzsewdr1AMlAGc50VrRrevOnClsom0MzA9uaHksq_X1I7moJFl0PW3AvcL0GJ0UmXBo Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 19:56:48.567714 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd20b488413a476aa45ee9c6d3ffbf70", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-1386628607 Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-1386628607-project Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 5a38bc1705a64785aaac2b561159fa26 Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-1386628607-project Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 19:56:48.569424 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'fde3a7b0-5fc1-4054-bd2c-0d24b239586b'} Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:56:48.570633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 19:56:48.572245 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 19:56:48.573879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Returning 404 to user: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:56:48.573879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ed2010b3-38b4-4490-96a0-84b04403d030 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 404 len: 111 microversion: 2.1 time: 0.040756 Jul 01 19:56:48.573879 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 629/1244] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:48 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:56:48.686964 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2101510380", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1459100450", "security_groups": [{"name": "tempest-secgroup-smoke-1233299789"}], "block_device_mapping_v2": [{"uuid": "ea615de0-eb50-4aaa-9d5b-048eecc3ec70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda1c18a-7073-4265-8264-0ef156ace9a6"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:48.811988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] validate_networks() for [('fda1c18a-7073-4265-8264-0ef156ace9a6', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:56:49.221725 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:56:49.222170 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:56:49.222635 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:56:49.223036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:56:49.223440 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:56:49.232598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.233035 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.233820 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.234276 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.251245 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:56:49.255418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for user 5a38bc1705a64785aaac2b561159fa26 and project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'instances', 'ram', 'cores'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:56:49.314246 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:56:49.316274 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea615de0-eb50-4aaa-9d5b-048eecc3ec70',volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:56:49.466088 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2a7ffa0f-c6bf-4e9c-aecd-7b061a4cee56 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783270 Jul 01 19:56:49.466857 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 616/1245] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:56:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:56:49.477001 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-45d1d568-34e9-4660-9f35-c2effb29da04 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:49.477612 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-45d1d568-34e9-4660-9f35-c2effb29da04 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:49.533010 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-45d1d568-34e9-4660-9f35-c2effb29da04 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:49.540473 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-45d1d568-34e9-4660-9f35-c2effb29da04 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1095 microversion: 2.1 time: 0.067452 Jul 01 19:56:49.542280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 630/1246] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:49 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:50.558155 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:50.558885 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:50.566201 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.566648 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.567416 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.567848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.647988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:50.656101 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b4da3919-7513-4f38-97b3-0cb3742976da tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1201 microversion: 2.1 time: 0.102112 Jul 01 19:56:50.656662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 617/1247] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:50 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:51.672853 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:51.673493 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:51.681320 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:51.681753 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:51.682596 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:51.683036 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:51.897772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:51.906314 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5465359d-c373-4db7-b635-34234d45999c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.237191 Jul 01 19:56:51.906898 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 631/1248] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:51 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:52.114075 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-411c755d-018e-4603-9c36-2957171149e6 req-647b6da2-0153-441b-a3d3-03f3c03b3dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8899bee1-a386-45db-90f4-2f2ce058ce2a", "tag": "5aea7518-675e-419e-9fbd-8c01507485a4"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:52.126319 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-411c755d-018e-4603-9c36-2957171149e6 req-647b6da2-0153-441b-a3d3-03f3c03b3dcc service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:52.127107 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-411c755d-018e-4603-9c36-2957171149e6 req-647b6da2-0153-441b-a3d3-03f3c03b3dcc service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:52.139418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-411c755d-018e-4603-9c36-2957171149e6 req-647b6da2-0153-441b-a3d3-03f3c03b3dcc service nova] Creating event network-changed:5aea7518-675e-419e-9fbd-8c01507485a4 for instance 8899bee1-a386-45db-90f4-2f2ce058ce2a on hv-cinder-83124 Jul 01 19:56:52.144967 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-411c755d-018e-4603-9c36-2957171149e6 req-647b6da2-0153-441b-a3d3-03f3c03b3dcc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040439 Jul 01 19:56:52.146260 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 618/1249] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:52.928009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:52.928998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:52.940194 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:52.940943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:52.942268 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:52.942999 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:53.081872 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:53.089847 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57ba381f-7740-40a7-ae59-f519a6d9a240 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.168468 Jul 01 19:56:53.090444 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 632/1250] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:52 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:54.108221 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:54.108904 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:54.115451 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.115890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.116729 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.117217 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.254334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:54.262061 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bce768ea-cb3f-4328-ac33-a3262207f056 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.158768 Jul 01 19:56:54.262631 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 619/1251] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:54 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:55.282961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:55.283920 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:55.292776 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:55.293228 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:55.294003 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:55.294471 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:55.439162 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:55.450982 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dfcf2de1-846a-4d43-9fdd-09a4454189be tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.174192 Jul 01 19:56:55.451864 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 633/1252] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:55 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:55.466916 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:56:55.467089 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 19:56:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:56:56.475342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:56.476369 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:56.483839 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:56.484315 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:56.485118 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:56.485572 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:56.625390 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:56.633305 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f4fef47a-2585-4eb0-8722-a6f0a300ee7a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.164480 Jul 01 19:56:56.633881 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 620/1253] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:56 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:57.654940 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:57.655961 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:57.667144 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:57.667900 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:57.669368 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:57.670244 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:57.817309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:57.825783 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-43110612-6099-45f0-9426-ab1c685c376f tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.177853 Jul 01 19:56:57.826390 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 634/1254] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:57 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:58.845712 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:58.846649 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:58.855588 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:58.856036 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:58.856812 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:58.857248 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:58.998790 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:59.006598 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a787a0f4-bfae-4ba9-990d-ec2d8daf58ae tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.167457 Jul 01 19:56:59.007161 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 621/1255] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:58 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:00.023957 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:00.024579 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:00.027022 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:00.032613 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:00.033054 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:00.033807 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:00.034344 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:00.170899 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:00.178633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-190d7990-c2b1-4d42-a25f-048593392ead tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.158785 Jul 01 19:57:00.179199 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 635/1256] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:00 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:01.205409 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:01.206468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:01.210224 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:01.211259 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:01.221670 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:01.222393 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.223838 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:01.224576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.358821 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:01.366610 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-91bcefa3-715f-4e4f-a679-f27699523535 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.167714 Jul 01 19:57:01.367163 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 622/1257] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:01 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:02.383992 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:02.384725 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:02.391635 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.392085 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.392849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.393280 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.528156 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:02.536155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6d53e0e5-b53b-45ac-9926-1b2da92b2a1a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.156142 Jul 01 19:57:02.536727 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 636/1258] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:02 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:03.553434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:03.554105 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:03.561074 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:03.561599 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:03.562295 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:03.562722 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:03.679608 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-08906580-f3be-4ebc-b8ac-6342e023ff17 req-3727965a-cce5-4bf0-b00e-ae51c23ff517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8899bee1-a386-45db-90f4-2f2ce058ce2a", "name": "network-vif-plugged", "status": "completed", "tag": "5aea7518-675e-419e-9fbd-8c01507485a4"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:03.691844 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-08906580-f3be-4ebc-b8ac-6342e023ff17 req-3727965a-cce5-4bf0-b00e-ae51c23ff517 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:03.692684 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-08906580-f3be-4ebc-b8ac-6342e023ff17 req-3727965a-cce5-4bf0-b00e-ae51c23ff517 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:03.703247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:03.705136 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-08906580-f3be-4ebc-b8ac-6342e023ff17 req-3727965a-cce5-4bf0-b00e-ae51c23ff517 service nova] Creating event network-vif-plugged:5aea7518-675e-419e-9fbd-8c01507485a4 for instance 8899bee1-a386-45db-90f4-2f2ce058ce2a on hv-cinder-83124 Jul 01 19:57:03.710500 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-08906580-f3be-4ebc-b8ac-6342e023ff17 req-3727965a-cce5-4bf0-b00e-ae51c23ff517 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035363 Jul 01 19:57:03.711105 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 637/1259] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:03.712452 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7017252c-88c0-433a-819b-edfccab5379c tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.162924 Jul 01 19:57:03.721023 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 623/1260] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:03 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:04.734569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:04.735751 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:04.746338 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:04.747069 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:04.748474 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:04.748927 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:04.891117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:04.901128 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-84c63341-6444-4b18-b823-b6cfe01a018b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1267 microversion: 2.1 time: 0.174420 Jul 01 19:57:04.901683 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 638/1261] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:04 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:05.921973 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:05.922723 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:05.929585 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.930058 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.930803 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.931230 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.066490 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.077937 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a47e0f71-f48c-41e7-a8b7-7474cc414537 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1454 microversion: 2.1 time: 0.161483 Jul 01 19:57:06.078567 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 624/1262] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:05 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:06.094282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:06.094923 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:06.101553 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.102008 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.102789 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.103214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.243874 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.251617 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9542b5d7-03da-4a24-b33a-51540304899b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1454 microversion: 2.1 time: 0.161281 Jul 01 19:57:06.252181 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 639/1263] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:06 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:08.113323 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-4efc3a5b-a2be-4fc8-bd11-3500b6baa6a3 req-983d4de4-5aab-41c5-a35b-28f510aa070d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8899bee1-a386-45db-90f4-2f2ce058ce2a", "tag": "5aea7518-675e-419e-9fbd-8c01507485a4"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:08.124686 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-4efc3a5b-a2be-4fc8-bd11-3500b6baa6a3 req-983d4de4-5aab-41c5-a35b-28f510aa070d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:08.125134 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-4efc3a5b-a2be-4fc8-bd11-3500b6baa6a3 req-983d4de4-5aab-41c5-a35b-28f510aa070d service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:08.136509 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-4efc3a5b-a2be-4fc8-bd11-3500b6baa6a3 req-983d4de4-5aab-41c5-a35b-28f510aa070d service nova] Creating event network-changed:5aea7518-675e-419e-9fbd-8c01507485a4 for instance 8899bee1-a386-45db-90f4-2f2ce058ce2a on hv-cinder-83124 Jul 01 19:57:08.141715 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-4efc3a5b-a2be-4fc8-bd11-3500b6baa6a3 req-983d4de4-5aab-41c5-a35b-28f510aa070d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Jul 01 19:57:08.142309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 625/1264] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:29.391468 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:58:29.392331 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 19:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:58:29.573485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 19:58:29.574123 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 19:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 19:59:21.026339 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [-] [274f721b-97cf-4940-b7bb-f091c3df39ed] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 01 19:59:21.026974 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:21.027755 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:21.034633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2019170076", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1459100450", "security_groups": [{"name": "tempest-secgroup-smoke-1233299789"}], "block_device_mapping_v2": [{"uuid": "4452032e-f649-48af-bc67-5b55b93ee2f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda1c18a-7073-4265-8264-0ef156ace9a6"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:21.267676 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] validate_networks() for [('fda1c18a-7073-4265-8264-0ef156ace9a6', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:59:21.755542 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:59:21.755968 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:59:21.756438 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:59:21.756849 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:59:21.757260 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:59:21.767152 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:21.767601 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:21.768405 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:21.768843 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:21.786053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:59:21.790574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Getting quotas for user 5a38bc1705a64785aaac2b561159fa26 and project dd20b488413a476aa45ee9c6d3ffbf70. Resources: {'instances', 'ram', 'cores'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:59:21.849503 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:59:21.851671 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4452032e-f649-48af-bc67-5b55b93ee2f7',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:59:21.993793 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5972a040-b805-4e91-9cfb-75664354bd62 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.970695 Jul 01 19:59:21.994462 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 640/1265] 10.222.0.61 () {60 vars in 1146 bytes} [Fri Jul 1 19:59:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:59:22.002521 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e8b0fa5-8ff4-4606-b803-d0c4b19eb404] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 01 19:59:22.003058 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:22.003818 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=68 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:22.008494 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6c568ab9-e99c-4ab7-9193-1383ed99064a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:22.009191 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6c568ab9-e99c-4ab7-9193-1383ed99064a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:22.129842 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6c568ab9-e99c-4ab7-9193-1383ed99064a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:22.137215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6c568ab9-e99c-4ab7-9193-1383ed99064a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1095 microversion: 2.1 time: 0.136474 Jul 01 19:59:22.137773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 626/1266] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:21 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1095 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:23.155998 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:23.156598 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:23.168155 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] [274f721b-97cf-4940-b7bb-f091c3df39ed] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36656. Jul 01 19:59:23.172549 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:23.172975 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:23.173822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:23.174244 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:23.267532 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:23.278300 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ba449f01-27af-41ce-88fb-9fc7d03dbcfc tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1211 microversion: 2.1 time: 0.127756 Jul 01 19:59:23.278885 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 641/1267] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:23 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:24.296664 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:24.297275 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:24.310176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:24.311176 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:24.311895 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:24.312334 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:24.318307 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e8b0fa5-8ff4-4606-b803-d0c4b19eb404] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36660. Jul 01 19:59:24.505369 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8110dc7c-5ede-4845-8128-97f9cb06452e req-0a88a7ed-70b5-489a-82cf-bf74151becaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dd80b5-308e-4258-a3ce-8c1064808f86", "tag": "9c95a401-ef71-4175-8dda-4ca680d45445"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:24.522519 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8110dc7c-5ede-4845-8128-97f9cb06452e req-0a88a7ed-70b5-489a-82cf-bf74151becaf service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:24.523385 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8110dc7c-5ede-4845-8128-97f9cb06452e req-0a88a7ed-70b5-489a-82cf-bf74151becaf service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:24.539086 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:24.547606 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8110dc7c-5ede-4845-8128-97f9cb06452e req-0a88a7ed-70b5-489a-82cf-bf74151becaf service nova] Creating event network-changed:9c95a401-ef71-4175-8dda-4ca680d45445 for instance b4dd80b5-308e-4258-a3ce-8c1064808f86 on hv-cinder-83124 Jul 01 19:59:24.552696 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-47fce733-bf1d-4a62-8686-a78059b04794 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.259715 Jul 01 19:59:24.553418 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 627/1268] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:24 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:24.559855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8110dc7c-5ede-4845-8128-97f9cb06452e req-0a88a7ed-70b5-489a-82cf-bf74151becaf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058424 Jul 01 19:59:24.560958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 642/1269] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:59:25.574167 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:25.574919 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:25.583584 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:25.584266 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:25.585092 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:25.585665 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:25.719647 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:25.727870 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0731e6bf-2c77-460b-856c-28c05019048a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.159718 Jul 01 19:59:25.728437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 628/1270] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:25 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:26.750674 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:26.751818 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:26.762569 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:26.763309 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:26.764567 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:26.765298 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:26.902625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:26.910983 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-358e553a-5248-43f0-acf7-91f0b051d105 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.168328 Jul 01 19:59:26.911550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 643/1271] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:26 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:27.932309 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:27.933676 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:27.944718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:27.945474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:27.946815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:27.947247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:28.082287 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:28.092151 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-57620673-2fef-4bee-91ec-c47439e59cf2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.166436 Jul 01 19:59:28.092754 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 629/1272] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:27 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:29.114458 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:29.115511 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:29.126550 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:29.127757 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:29.129029 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:29.129752 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:29.271682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:29.283958 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c1d0d273-8b0a-49be-ba62-c71074587359 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.177099 Jul 01 19:59:29.284803 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 644/1273] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:29 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:30.305558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:30.306718 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:30.314746 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:30.315247 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:30.316129 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:30.316613 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:30.450098 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:30.462151 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc5ea726-ac16-4ba4-b93a-6f7e891e06cf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.162813 Jul 01 19:59:30.462726 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 630/1274] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:30 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:31.480680 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:31.481282 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:31.488162 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:31.488615 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:31.489369 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:31.489806 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:31.638772 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:31.646647 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e0a3e6ad-b0db-4b28-b8c5-ae956de02fba tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.170653 Jul 01 19:59:31.647216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 645/1275] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:31 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:32.667775 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:32.668786 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:32.672478 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:32.681721 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:32.682493 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:32.683609 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:32.684046 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:32.823445 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:32.831588 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1a16f4d1-659b-4008-9915-546f180aeac7 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.170383 Jul 01 19:59:32.832157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 631/1276] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:32 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:33.852994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:33.853857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:33.856185 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:33.856984 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:33.864223 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:33.864695 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:33.865498 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:33.865982 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:34.000258 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:34.012119 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fccc0bb1-d78e-4de8-bbcd-3a0ebbbe4996 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.165525 Jul 01 19:59:34.012871 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 646/1277] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:33 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:35.029410 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:35.030038 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:35.037221 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:35.037669 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:35.038473 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:35.038899 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:35.182310 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:35.190979 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3488e832-930b-4541-8f17-9ab7e2ccb51b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.165517 Jul 01 19:59:35.191558 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 632/1278] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:35 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:36.217007 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:36.218086 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:36.229081 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:36.229809 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:36.230634 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:36.231071 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:36.372568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:36.381988 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-449b3f84-2a7d-496c-9f7a-19b5ef3acb0a tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.174677 Jul 01 19:59:36.382735 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 647/1279] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:36 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:36.463392 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-1a170104-6585-454f-9fbb-5026a260f728 req-0b19891b-c5f9-47c3-8224-0ea90b514756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dd80b5-308e-4258-a3ce-8c1064808f86", "name": "network-vif-plugged", "status": "completed", "tag": "9c95a401-ef71-4175-8dda-4ca680d45445"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:36.474027 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1a170104-6585-454f-9fbb-5026a260f728 req-0b19891b-c5f9-47c3-8224-0ea90b514756 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:36.474398 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1a170104-6585-454f-9fbb-5026a260f728 req-0b19891b-c5f9-47c3-8224-0ea90b514756 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:36.486632 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-1a170104-6585-454f-9fbb-5026a260f728 req-0b19891b-c5f9-47c3-8224-0ea90b514756 service nova] Creating event network-vif-plugged:9c95a401-ef71-4175-8dda-4ca680d45445 for instance b4dd80b5-308e-4258-a3ce-8c1064808f86 on hv-cinder-83124 Jul 01 19:59:36.491736 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-1a170104-6585-454f-9fbb-5026a260f728 req-0b19891b-c5f9-47c3-8224-0ea90b514756 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101416 Jul 01 19:59:36.492324 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 633/1280] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:37.403186 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:37.404123 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:37.415489 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:37.416231 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:37.417305 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:37.417768 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:37.555862 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:37.564272 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-65b6ba71-11d8-4a45-a09b-2680a85e64c2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1267 microversion: 2.1 time: 0.167785 Jul 01 19:59:37.564846 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 648/1281] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:37 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:38.586474 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:38.587279 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:38.594443 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:38.594893 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:38.595663 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:38.596097 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:38.727773 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:38.739342 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-04831894-42bf-441a-a312-0234cd27eb6e tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1455 microversion: 2.1 time: 0.160217 Jul 01 19:59:38.740099 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 634/1282] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:38 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:38.757775 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:38.758361 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:38.765095 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:38.765535 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:38.766330 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:38.766756 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:38.931110 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:38.939216 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec3dd646-85f2-4f23-9d5f-28251d3bc110 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1455 microversion: 2.1 time: 0.185358 Jul 01 19:59:38.939827 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 649/1283] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:38 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:59:40.978219 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-64553fb8-05bf-4c4d-b857-5391f21ed972 req-97ec5e3b-f2cb-44fe-bbe6-9f847c6fec54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dd80b5-308e-4258-a3ce-8c1064808f86", "tag": "9c95a401-ef71-4175-8dda-4ca680d45445"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:40.986353 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-64553fb8-05bf-4c4d-b857-5391f21ed972 req-97ec5e3b-f2cb-44fe-bbe6-9f847c6fec54 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:40.986802 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-64553fb8-05bf-4c4d-b857-5391f21ed972 req-97ec5e3b-f2cb-44fe-bbe6-9f847c6fec54 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:40.997996 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-64553fb8-05bf-4c4d-b857-5391f21ed972 req-97ec5e3b-f2cb-44fe-bbe6-9f847c6fec54 service nova] Creating event network-changed:9c95a401-ef71-4175-8dda-4ca680d45445 for instance b4dd80b5-308e-4258-a3ce-8c1064808f86 on hv-cinder-83124 Jul 01 19:59:41.003316 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-64553fb8-05bf-4c4d-b857-5391f21ed972 req-97ec5e3b-f2cb-44fe-bbe6-9f847c6fec54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087140 Jul 01 19:59:41.004625 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 635/1284] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:40.790087 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:40.790855 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=52 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:40.794994 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:40.795495 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:40.797158 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-ecae4a01-2169-4caf-a10a-63b95b0f4d77 req-875f1429-44c6-4654-a302-6b65fc8007ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dd80b5-308e-4258-a3ce-8c1064808f86", "tag": "9c95a401-ef71-4175-8dda-4ca680d45445"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:40.803524 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:40.803973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:40.804734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:40.804890 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=22 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:40.805574 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:40.805764 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=46 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:40.808708 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ecae4a01-2169-4caf-a10a-63b95b0f4d77 req-875f1429-44c6-4654-a302-6b65fc8007ed service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:40.809357 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ecae4a01-2169-4caf-a10a-63b95b0f4d77 req-875f1429-44c6-4654-a302-6b65fc8007ed service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:40.821489 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-ecae4a01-2169-4caf-a10a-63b95b0f4d77 req-875f1429-44c6-4654-a302-6b65fc8007ed service nova] Creating event network-changed:9c95a401-ef71-4175-8dda-4ca680d45445 for instance b4dd80b5-308e-4258-a3ce-8c1064808f86 on hv-cinder-83124 Jul 01 20:01:40.826823 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-ecae4a01-2169-4caf-a10a-63b95b0f4d77 req-875f1429-44c6-4654-a302-6b65fc8007ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Jul 01 20:01:40.827706 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 636/1285] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:40.833293 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:01:40.927040 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-faaf57ff-e3b2-4013-abbe-390421c8357d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 204 len: 0 microversion: 2.1 time: 0.138756 Jul 01 20:01:40.927807 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 650/1286] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 20:01:40 2022] DELETE /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:01:40.937203 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:40.938018 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:40.944960 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:40.945434 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:40.946565 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:40.947022 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:41.116489 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:41.124010 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a7dfa876-7fe1-4570-89f1-47779439c391 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1580 microversion: 2.1 time: 0.191485 Jul 01 20:01:41.124575 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 637/1287] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:40 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1580 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:42.144310 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:42.144995 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:42.152165 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:42.152614 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:42.153420 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:42.153857 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:42.363442 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:42.375813 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5feed688-2845-407a-a66a-a64f32c1c1c0 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1580 microversion: 2.1 time: 0.237279 Jul 01 20:01:42.376734 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 651/1288] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:42 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1580 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:43.345484 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-01c79d57-4874-4a58-a142-52644d550b57 req-77d2de2a-bdad-4942-9e1b-49314786c8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dd80b5-308e-4258-a3ce-8c1064808f86", "name": "network-vif-deleted", "tag": "9c95a401-ef71-4175-8dda-4ca680d45445"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:43.354374 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-01c79d57-4874-4a58-a142-52644d550b57 req-77d2de2a-bdad-4942-9e1b-49314786c8ed service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:43.354815 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-01c79d57-4874-4a58-a142-52644d550b57 req-77d2de2a-bdad-4942-9e1b-49314786c8ed service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:43.365988 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-01c79d57-4874-4a58-a142-52644d550b57 req-77d2de2a-bdad-4942-9e1b-49314786c8ed service nova] Creating event network-vif-deleted:9c95a401-ef71-4175-8dda-4ca680d45445 for instance b4dd80b5-308e-4258-a3ce-8c1064808f86 on hv-cinder-83124 Jul 01 20:01:43.370752 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-01c79d57-4874-4a58-a142-52644d550b57 req-77d2de2a-bdad-4942-9e1b-49314786c8ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028996 Jul 01 20:01:43.371557 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 638/1289] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:43.400737 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:43.401375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:43.408826 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:43.410214 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:43.411357 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:43.411801 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:43.479485 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:43.488028 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2fcde082-b2dd-4ae0-b671-60b156dbbbbf tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 200 len: 1226 microversion: 2.1 time: 0.091615 Jul 01 20:01:43.488603 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 652/1290] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:43 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:44.513630 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:44.514926 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: b4dd80b5-308e-4258-a3ce-8c1064808f86] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:44.527696 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:44.528437 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:44.529698 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:44.530459 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:44.552462 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] HTTP exception thrown: Instance b4dd80b5-308e-4258-a3ce-8c1064808f86 could not be found. Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Request method failure captured: Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 HTTP/1.1 Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv1C4ZviDDEXLQ7S8bqCLD0Q9c19744wzvE3urzHu0e6VvA0D8Kt_Hsp4V4qvLt3UUTcfeXzgz6udSEZZi585SwB8OGicIry9H2xzNUl5UVBVFzsewdr1AMlAGc50VrRrevOnClsom0MzA9uaHksq_X1I7moJFl0PW3AvcL0GJ0UmXBo Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 20:01:44.554130 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd20b488413a476aa45ee9c6d3ffbf70", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 5a38bc1705a64785aaac2b561159fa26 Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance b4dd80b5-308e-4258-a3ce-8c1064808f86 could not be found. Jul 01 20:01:44.555918 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'b4dd80b5-308e-4258-a3ce-8c1064808f86'} Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dd80b5-308e-4258-a3ce-8c1064808f86 could not be found. Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:01:44.557256 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dd80b5-308e-4258-a3ce-8c1064808f86 could not be found. Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dd80b5-308e-4258-a3ce-8c1064808f86 could not be found. Jul 01 20:01:44.558923 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:44.560512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Returning 404 to user: Instance b4dd80b5-308e-4258-a3ce-8c1064808f86 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:01:44.560512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-57cc3ea8-8eea-4bb9-b5c3-8ac83b9e026b tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86" status: 404 len: 111 microversion: 2.1 time: 0.051935 Jul 01 20:01:44.560512 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 639/1291] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:44 2022] GET /compute/v2.1/servers/b4dd80b5-308e-4258-a3ce-8c1064808f86 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:01:47.677270 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-4bd59b58-5c07-425b-b3bc-55dbc536a290 req-788f2764-f859-4978-9581-973b35915528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8899bee1-a386-45db-90f4-2f2ce058ce2a", "tag": "5aea7518-675e-419e-9fbd-8c01507485a4"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:47.677866 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:47.678269 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:47.689161 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-4bd59b58-5c07-425b-b3bc-55dbc536a290 req-788f2764-f859-4978-9581-973b35915528 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:47.689614 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-4bd59b58-5c07-425b-b3bc-55dbc536a290 req-788f2764-f859-4978-9581-973b35915528 service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:47.694332 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:47.694708 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:47.700630 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:47.701307 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:47.705576 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-4bd59b58-5c07-425b-b3bc-55dbc536a290 req-788f2764-f859-4978-9581-973b35915528 service nova] Creating event network-changed:5aea7518-675e-419e-9fbd-8c01507485a4 for instance 8899bee1-a386-45db-90f4-2f2ce058ce2a on hv-cinder-83124 Jul 01 20:01:47.711189 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-4bd59b58-5c07-425b-b3bc-55dbc536a290 req-788f2764-f859-4978-9581-973b35915528 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038282 Jul 01 20:01:47.713615 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 640/1292] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:01:47.730801 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:01:47.845053 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5d606bb3-9d93-4907-8b9f-900d1bdfbc18 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 204 len: 0 microversion: 2.1 time: 0.176257 Jul 01 20:01:47.845682 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 653/1293] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 20:01:47 2022] DELETE /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:01:47.854832 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:47.855531 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:47.862273 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:47.862752 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:47.863980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:47.863980 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:48.000744 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:48.008425 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4a85010b-2d6b-477a-8972-5487f07f72b9 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1579 microversion: 2.1 time: 0.157862 Jul 01 20:01:48.008955 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 641/1294] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:47 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:49.031475 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:49.032508 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:49.043592 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:49.044328 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:49.045568 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:49.046329 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:49.181860 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:49.189633 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-88960438-a6fe-4725-9822-00d47efe72cd tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1579 microversion: 2.1 time: 0.165429 Jul 01 20:01:49.190233 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 654/1295] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:49 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:49.403201 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:01:49.404145 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 20:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:01:49.584459 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:01:49.584977 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 20:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:01:50.206637 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:50.207404 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:50.213822 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.214287 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.215048 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.215476 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.254681 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-842fb55d-8cec-4324-8311-5fac3487afdb req-c1697e08-57d0-4b6d-a460-c4362894e34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8899bee1-a386-45db-90f4-2f2ce058ce2a", "name": "network-vif-deleted", "tag": "5aea7518-675e-419e-9fbd-8c01507485a4"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:50.262985 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-842fb55d-8cec-4324-8311-5fac3487afdb req-c1697e08-57d0-4b6d-a460-c4362894e34c service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.263330 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-842fb55d-8cec-4324-8311-5fac3487afdb req-c1697e08-57d0-4b6d-a460-c4362894e34c service nova] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.274662 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-842fb55d-8cec-4324-8311-5fac3487afdb req-c1697e08-57d0-4b6d-a460-c4362894e34c service nova] Creating event network-vif-deleted:5aea7518-675e-419e-9fbd-8c01507485a4 for instance 8899bee1-a386-45db-90f4-2f2ce058ce2a on hv-cinder-83124 Jul 01 20:01:50.276817 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a38bc1705a64785aaac2b561159fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd20b488413a476aa45ee9c6d3ffbf70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:50.279258 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-842fb55d-8cec-4324-8311-5fac3487afdb req-c1697e08-57d0-4b6d-a460-c4362894e34c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169445 Jul 01 20:01:50.279853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 642/1296] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:50.285321 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d34be4a4-b4e9-4bb0-89fc-4b82f79ea894 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 200 len: 1226 microversion: 2.1 time: 0.082525 Jul 01 20:01:50.285875 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 655/1297] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:50 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:51.308112 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:51.308954 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: 8899bee1-a386-45db-90f4-2f2ce058ce2a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:51.316765 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.317225 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.318246 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.318756 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.334645 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] HTTP exception thrown: Instance 8899bee1-a386-45db-90f4-2f2ce058ce2a could not be found. Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Request method failure captured: Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a HTTP/1.1 Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv1C4ZviDDEXLQ7S8bqCLD0Q9c19744wzvE3urzHu0e6VvA0D8Kt_Hsp4V4qvLt3UUTcfeXzgz6udSEZZi585SwB8OGicIry9H2xzNUl5UVBVFzsewdr1AMlAGc50VrRrevOnClsom0MzA9uaHksq_X1I7moJFl0PW3AvcL0GJ0UmXBo Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 20:01:51.336620 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd20b488413a476aa45ee9c6d3ffbf70", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 5a38bc1705a64785aaac2b561159fa26 Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance 8899bee1-a386-45db-90f4-2f2ce058ce2a could not be found. Jul 01 20:01:51.338348 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': '8899bee1-a386-45db-90f4-2f2ce058ce2a'} Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8899bee1-a386-45db-90f4-2f2ce058ce2a could not be found. Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:01:51.339288 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8899bee1-a386-45db-90f4-2f2ce058ce2a could not be found. Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8899bee1-a386-45db-90f4-2f2ce058ce2a could not be found. Jul 01 20:01:51.340859 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.342377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Returning 404 to user: Instance 8899bee1-a386-45db-90f4-2f2ce058ce2a could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:01:51.342377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-01e017ec-075c-4374-88e1-6a7188319d83 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a" status: 404 len: 111 microversion: 2.1 time: 0.037558 Jul 01 20:01:51.342377 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 643/1298] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:51 2022] GET /compute/v2.1/servers/8899bee1-a386-45db-90f4-2f2ce058ce2a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:01:51.819517 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:51.820042 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:51.830453 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.831015 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.832180 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.832687 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.847620 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] HTTP exception thrown: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Request method failure captured: Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b HTTP/1.1 Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept: application/json Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Connection: close Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Length: 0 Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Content-Type: application/json Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Host: 10.222.0.61 Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABiv1C4ZviDDEXLQ7S8bqCLD0Q9c19744wzvE3urzHu0e6VvA0D8Kt_Hsp4V4qvLt3UUTcfeXzgz6udSEZZi585SwB8OGicIry9H2xzNUl5UVBVFzsewdr1AMlAGc50VrRrevOnClsom0MzA9uaHksq_X1I7moJFl0PW3AvcL0GJ0UmXBo Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Id: None Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Domain-Name: None Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Role: member,reader Jul 01 20:01:51.849273 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Roles: member,reader Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd20b488413a476aa45ee9c6d3ffbf70", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Id: 5a38bc1705a64785aaac2b561159fa26 Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: method: > Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: exception: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.850943 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: action_args: {'id': 'fde3a7b0-5fc1-4054-bd2c-0d24b239586b'} Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:01:51.851936 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.853545 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.855375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Returning 404 to user: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:01:51.855375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9c93a696-a2b5-4bac-8780-acbed37a9f4d tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 404 len: 111 microversion: 2.1 time: 0.037860 Jul 01 20:01:51.855375 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 656/1299] 10.222.0.61 () {58 vars in 1238 bytes} [Fri Jul 1 20:01:51 2022] DELETE /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:01:51.859421 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:51.860028 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] [instance: fde3a7b0-5fc1-4054-bd2c-0d24b239586b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:51.866461 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.866960 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.867807 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.868238 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Lock "cbee45c5-2524-4b35-9632-4c8e49d2b565" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.881586 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] HTTP exception thrown: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Request method failure captured: Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b HTTP/1.1 Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept: application/json Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Connection: close Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Length: 0 Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Content-Type: application/json Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Host: 10.222.0.61 Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABiv1C4ZviDDEXLQ7S8bqCLD0Q9c19744wzvE3urzHu0e6VvA0D8Kt_Hsp4V4qvLt3UUTcfeXzgz6udSEZZi585SwB8OGicIry9H2xzNUl5UVBVFzsewdr1AMlAGc50VrRrevOnClsom0MzA9uaHksq_X1I7moJFl0PW3AvcL0GJ0UmXBo Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Id: None Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Domain-Name: None Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Role: member,reader Jul 01 20:01:51.883154 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Roles: member,reader Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd20b488413a476aa45ee9c6d3ffbf70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd20b488413a476aa45ee9c6d3ffbf70", "adminURL": "http://10.222.0.61:8080"}]}] Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Id: dd20b488413a476aa45ee9c6d3ffbf70 Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-TestVolumeBootPattern-1386628607 Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Id: 5a38bc1705a64785aaac2b561159fa26 Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-TestVolumeBootPattern-1386628607-project Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: method: > Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: exception: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.884997 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: action_args: {'id': 'fde3a7b0-5fc1-4054-bd2c-0d24b239586b'} Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:01:51.886048 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. Jul 01 20:01:51.887824 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Jul 01 20:01:51.889387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Returning 404 to user: Instance fde3a7b0-5fc1-4054-bd2c-0d24b239586b could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:01:51.889387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-57f74734-2728-47bd-b141-f514dfd301b2 tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b" status: 404 len: 111 microversion: 2.1 time: 0.028961 Jul 01 20:01:51.889387 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 644/1300] 10.222.0.61 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:51 2022] GET /compute/v2.1/servers/fde3a7b0-5fc1-4054-bd2c-0d24b239586b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:01:53.204729 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-68d81932-6a17-4354-b166-c4673432c9ac tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] Calling method '.version_select at 0x7f476471c0d0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:53.228973 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-68d81932-6a17-4354-b166-c4673432c9ac tempest-TestVolumeBootPattern-1386628607 tempest-TestVolumeBootPattern-1386628607-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1459100450" status: 202 len: 0 microversion: 2.1 time: 0.028215 Jul 01 20:01:53.229625 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 657/1301] 10.222.0.61 () {58 vars in 1262 bytes} [Fri Jul 1 20:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1459100450 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:01:55.478558 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:01:55.479329 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 20:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:02:00.255352 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:02:00.255854 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 20:02:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:03:54.010157 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:03:54.011060 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 20:03:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:04:01.927175 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:04:01.928158 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 20:04:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:05:09.413215 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:05:09.413853 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 20:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:05:09.594652 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:05:09.595620 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 20:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:05:15.487531 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:05:15.488297 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 20:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:05:20.264806 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:05:20.265677 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 20:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:07:14.021701 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:07:14.022848 dv-cinder-831247-20-iscsi devstack@n-api.service[124349]: Fri Jul 1 20:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:07:21.941117 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:07:21.942009 dv-cinder-831247-20-iscsi devstack@n-api.service[124350]: Fri Jul 1 20:07:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!